[GitHub] carbondata pull request #1234: fix bug in Spi2CarbondataTypeMapper method, i...

classic Classic list List threaded Threaded
36 messages Options
12
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
Github user anubhav100 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    @linqer i am unable to reproduce this bug on latest master branch can you provide more details


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user linqer commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    chould you give your skype ? i can show you it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user anubhav100 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    @linquer can you give me your CSV using the steps you give to me I can not replicate the bug and you can show it to me on wechat


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user linqer commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    [nationdata.zip](https://github.com/apache/carbondata/files/1233173/nationdata.zip)
    this is data file


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user linqer commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    # 1. The latest master code have this issue:
   
    ![latestcode](https://user-images.githubusercontent.com/2104057/29442563-f546ed3c-8404-11e7-9abb-8cddfafac9a5.png)
   
    `create statement: carbon.sql("create table nation ( n_nationkey int, n_name string, n_regionkey int, n_comment string ) stored by 'carbondata'")`
   
    `load statement: carbon.sql("LOAD DATA INPATH '/viphome/qr/testdata/nation_null.csv' INTO TABLE nation  OPTIONS('DELIMITER'='\u0001')")`
   
    **//Note: "select * from nation " is ok;  but " select * from nation where n_name='INDIA' throws exception**
    `sql: select * from nation where n_name='INDIA'; `
   
    ![image](https://user-images.githubusercontent.com/2104057/29442574-0640e480-8405-11e7-833f-61149019a60e.png)
    ![image](https://user-images.githubusercontent.com/2104057/29442579-0ec4ce78-8405-11e7-8989-be7a907623bb.png)
   
    # 2. pr-1234 can fix this issue
    `git fetch origin pull/1234/head:pr-1234`
   
    `sql: select * from nation where n_name='INDIA`
    ![image](https://user-images.githubusercontent.com/2104057/29442610-42cce89a-8405-11e7-8aea-ab9146241d23.png)
   
   



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user anubhav100 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    @linqer please give me nation_null.CSV as well I will try to replicate it again today



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user linqer commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    yes, I have upload it . could you see my comment above?
    "nationdata.zip
    this is data file"


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user anubhav100 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    @linqer ya i will review it


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user anubhav100 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    @linqer
   
    in carbon
     
     create table nation5 ( n_nationkey int, n_name string, n_regionkey int, n_comment string ) stored by 'carbondata';
   
    LOAD DATA INPATH '/nation.csv' INTO TABLE nation5 OPTIONS('DELIMITER'='|' , 'QUOTECHAR'='\"','FILEHEADER'='N_NATIONKEY,N_NAME,N_REGIONKEY,N_COMMENT');
   
    0: jdbc:hive2://localhost:10000> select * from nation5 where n_name='INDIA';
    +--------------+---------+--------------+--------------------------------------------------------------------+--+
    | n_nationkey  | n_name  | n_regionkey  |                             n_comment                              |
    +--------------+---------+--------------+--------------------------------------------------------------------+--+
    | 8            | INDIA   | 2            | ss excuses cajole slyly across the packages. deposits print aroun  |
    +--------------+---------+--------------+--------------------------------------------------------------------+--+
   
    in presto
   
    presto:default> select * from nation5 where n_name='INDIA';
     n_nationkey | n_name | n_regionkey |                             n_comment                            
    -------------+--------+-------------+-------------------------------------------------------------------
               8 | INDIA  |           2 | ss excuses cajole slyly across the packages. deposits print aroun
    (1 row)
   
    Query 20170818_092022_00001_7u72x, FINISHED, 1 node
    Splits: 17 total, 17 done (100.00%)
    0:16 [1 rows, 4B] [0 rows/s, 0B/s]



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user anubhav100 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    @linqer plus in your script for load command
   
    0: jdbc:hive2://localhost:10000> LOAD DATA INPATH '/nation_null.csv' INTO TABLE nation4 OPTIONS('DELIMITER'='\u0001');
    Error: scala.StringContext$InvalidEscapeException: invalid escape '\u' not one of [\b, \t, \n, \f, \r, \\, \", \'] at index 0 in "\u0001". Use \\ for literal \. (state=,code=0)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    SDV Build Success with Spark 2.1, Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/247/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user chenliang613 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    SDV Build Success with Spark 2.1, Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/279/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user anubhav100 commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    @linqer as you suggested i tried it on 3 node presto cluster but bug is not getting replicated
   
    in presto
   
    select * from nation where n_name='INDIA';
    n_nationkey | n_name | n_regionkey |                             n_comment                            
    -------------+--------+-------------+-------------------------------------------------------------------
              8 | INDIA  |           2 | ss excuses cajole slyly across the packages. deposits print aroun
    (1 row)
   
    this is my cordinator config.properties file
   
    coordinator=true
    node-scheduler.include-coordinator=false
    http-server.http.port=8086
    query.initial-hash-partitions=3
    query.max-memory=10GB
    query.max-memory-per-node=5GB
    discovery-server.enabled=true
    task.concurrency=4
    discovery.uri=


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #1234: fix bug in Spi2CarbondataTypeMapper method, i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user linqer closed the pull request at:

    https://github.com/apache/carbondata/pull/1234


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #1234: fix bug in Spi2CarbondataTypeMapper method, it will ...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user linqer commented on the issue:

    https://github.com/apache/carbondata/pull/1234
 
    yes, it can works fine with presto 0.164+, can't not work with 0.164-;


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
12