[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

classic Classic list List threaded Threaded
177 messages Options
1234567 ... 9
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/972/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/776/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Failed  with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9041/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/973/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xubo245 commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    retest this please


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/778/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9043/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/975/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xubo245 commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    retest this please


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/779/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9044/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/976/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xubo245 commented on the issue:

    https://github.com/apache/carbondata/pull/2792
 
    @KanakaKumar @kunal642 @ajantha-bhat @jackylk please review it.


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xuchuanyin commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2792#discussion_r226553321
 
    --- Diff: docs/CSDK-guide.md ---
    @@ -68,20 +68,42 @@ JNIEnv *initJVM() {
     bool readFromLocalWithoutProjection(JNIEnv *env) {
     
         CarbonReader carbonReaderClass;
    -    carbonReaderClass.builder(env, "../resources/carbondata", "test");
    +    carbonReaderClass.builder(env, "../resources/carbondata");
         carbonReaderClass.build();
     
    +    printf("\nRead data from local  without projection:\n");
    --- End diff --
   
    extra blanks found in `local  without`


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xuchuanyin commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2792#discussion_r226554812
 
    --- Diff: docs/documentation.md ---
    @@ -31,7 +31,7 @@ Apache CarbonData is a new big data file format for faster interactive query usi
     
     **CarbonData SQL Language Reference:** CarbonData extends the Spark SQL language and adds several [DDL](./ddl-of-carbondata.md) and [DML](./dml-of-carbondata.md) statements to support operations on it.Refer to the [Reference Manual](./language-manual.md) to understand the supported features and functions.
     
    -**Programming Guides:** You can read our guides about [APIs supported](./sdk-guide.md) to learn how to integrate CarbonData with your applications.
    +**Programming Guides:** You can read our guides about [Java APIs supported](./sdk-guide.md) or [C++ APIs supported](./CSDK-guide.md) to learn how to integrate CarbonData with your applications.
    --- End diff --
   
    remember to optimize the filename of the doc


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xuchuanyin commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2792#discussion_r226555131
 
    --- Diff: docs/CSDK-guide.md ---
    @@ -68,20 +68,42 @@ JNIEnv *initJVM() {
     bool readFromLocalWithoutProjection(JNIEnv *env) {
     
         CarbonReader carbonReaderClass;
    -    carbonReaderClass.builder(env, "../resources/carbondata", "test");
    +    carbonReaderClass.builder(env, "../resources/carbondata");
         carbonReaderClass.build();
     
    +    printf("\nRead data from local  without projection:\n");
    +
    +    CarbonRow carbonRow(env);
    --- End diff --
   
    oh, I find this in *.cpp.


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xuchuanyin commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2792#discussion_r226554587
 
    --- Diff: docs/CSDK-guide.md ---
    @@ -68,20 +68,42 @@ JNIEnv *initJVM() {
     bool readFromLocalWithoutProjection(JNIEnv *env) {
     
         CarbonReader carbonReaderClass;
    -    carbonReaderClass.builder(env, "../resources/carbondata", "test");
    +    carbonReaderClass.builder(env, "../resources/carbondata");
         carbonReaderClass.build();
     
    +    printf("\nRead data from local  without projection:\n");
    +
    +    CarbonRow carbonRow(env);
    --- End diff --
   
    What is this? I cannot recognize this grammar.


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xuchuanyin commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2792#discussion_r226555519
 
    --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/RowUtil.java ---
    @@ -0,0 +1,146 @@
    +/*
    + * Licensed to the Apache Software Foundation (ASF) under one or more
    + * contributor license agreements.  See the NOTICE file distributed with
    + * this work for additional information regarding copyright ownership.
    + * The ASF licenses this file to You under the Apache License, Version 2.0
    + * (the "License"); you may not use this file except in compliance with
    + * the License.  You may obtain a copy of the License at
    + *
    + *    http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.carbondata.sdk.file;
    +
    +import java.io.Serializable;
    +import java.math.BigDecimal;
    +
    +/**
    + * This row class is used to transfer the row data from one step to other step
    + */
    +public class RowUtil implements Serializable {
    +
    +  public static String getString(Object[] data, int ordinal) {
    +    return (String) data[ordinal];
    +  }
    +
    +  /**
    +   * get short type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return short data type data
    +   */
    +  public static short getShort(Object[] data, int ordinal) {
    +    return (short) data[ordinal];
    +  }
    +
    +  /**
    +   * get int data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return int data type data
    +   */
    +  public static int getInt(Object[] data, int ordinal) {
    +    return (Integer) data[ordinal];
    +  }
    +
    +  /**
    +   * get long data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return long data type data
    +   */
    +  public static long getLong(Object[] data, int ordinal) {
    +    return (long) data[ordinal];
    +  }
    +
    +  /**
    +   * get array data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return array data type data
    +   */
    +  public static Object[] getArray(Object[] data, int ordinal) {
    +    return (Object[]) data[ordinal];
    +  }
    +
    +  /**
    +   * get double data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return double data type data
    +   */
    +  public static double getDouble(Object[] data, int ordinal) {
    +    return (double) data[ordinal];
    +  }
    +
    +  /**
    +   * get boolean data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return boolean data type data
    +   */
    +  public static boolean getBoolean(Object[] data, int ordinal) {
    +    return (boolean) data[ordinal];
    +  }
    +
    +  /**
    +   * get byte data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return byte data type data
    +   */
    +  public static Byte getByte(Object[] data, int ordinal) {
    +    return (Byte) data[ordinal];
    +  }
    +
    +  /**
    +   * get float data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return float data type data
    +   */
    +  public static float getFloat(Object[] data, int ordinal) {
    +    return (float) data[ordinal];
    +  }
    +
    +  /**
    +   * get varchar data type data by ordinal
    +   * This is for CSDK
    +   * JNI don't support varchar, so carbon convert decimal to string
    --- End diff --
   
    `convert decimal to string`?


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xuchuanyin commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2792#discussion_r226553168
 
    --- Diff: README.md ---
    @@ -61,6 +61,7 @@ CarbonData is built using Apache Maven, to [build CarbonData](https://github.com
      * [CarbonData Pre-aggregate DataMap](https://github.com/apache/carbondata/blob/master/docs/preaggregate-datamap-guide.md)
      * [CarbonData Timeseries DataMap](https://github.com/apache/carbondata/blob/master/docs/timeseries-datamap-guide.md)
     * [SDK Guide](https://github.com/apache/carbondata/blob/master/docs/sdk-guide.md)
    +* [CSDK Guide](https://github.com/apache/carbondata/blob/master/docs/CSDK-guide.md)
    --- End diff --
   
    please keep the file name lowercase


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2792: [CARBONDATA-2981] Support read primitive data...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user xubo245 commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2792#discussion_r226560544
 
    --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/RowUtil.java ---
    @@ -0,0 +1,146 @@
    +/*
    + * Licensed to the Apache Software Foundation (ASF) under one or more
    + * contributor license agreements.  See the NOTICE file distributed with
    + * this work for additional information regarding copyright ownership.
    + * The ASF licenses this file to You under the Apache License, Version 2.0
    + * (the "License"); you may not use this file except in compliance with
    + * the License.  You may obtain a copy of the License at
    + *
    + *    http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.carbondata.sdk.file;
    +
    +import java.io.Serializable;
    +import java.math.BigDecimal;
    +
    +/**
    + * This row class is used to transfer the row data from one step to other step
    + */
    +public class RowUtil implements Serializable {
    +
    +  public static String getString(Object[] data, int ordinal) {
    +    return (String) data[ordinal];
    +  }
    +
    +  /**
    +   * get short type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return short data type data
    +   */
    +  public static short getShort(Object[] data, int ordinal) {
    +    return (short) data[ordinal];
    +  }
    +
    +  /**
    +   * get int data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return int data type data
    +   */
    +  public static int getInt(Object[] data, int ordinal) {
    +    return (Integer) data[ordinal];
    +  }
    +
    +  /**
    +   * get long data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return long data type data
    +   */
    +  public static long getLong(Object[] data, int ordinal) {
    +    return (long) data[ordinal];
    +  }
    +
    +  /**
    +   * get array data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return array data type data
    +   */
    +  public static Object[] getArray(Object[] data, int ordinal) {
    +    return (Object[]) data[ordinal];
    +  }
    +
    +  /**
    +   * get double data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return double data type data
    +   */
    +  public static double getDouble(Object[] data, int ordinal) {
    +    return (double) data[ordinal];
    +  }
    +
    +  /**
    +   * get boolean data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return boolean data type data
    +   */
    +  public static boolean getBoolean(Object[] data, int ordinal) {
    +    return (boolean) data[ordinal];
    +  }
    +
    +  /**
    +   * get byte data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return byte data type data
    +   */
    +  public static Byte getByte(Object[] data, int ordinal) {
    +    return (Byte) data[ordinal];
    +  }
    +
    +  /**
    +   * get float data type data by ordinal
    +   *
    +   * @param data carbon row data
    +   * @param ordinal the data index of Row
    +   * @return float data type data
    +   */
    +  public static float getFloat(Object[] data, int ordinal) {
    +    return (float) data[ordinal];
    +  }
    +
    +  /**
    +   * get varchar data type data by ordinal
    +   * This is for CSDK
    +   * JNI don't support varchar, so carbon convert decimal to string
    --- End diff --
   
    yes


---
1234567 ... 9