[GitHub] carbondata pull request #2589: [WIP][CARBONSTORE] add ParallelScanStore inte...

classic Classic list List threaded Threaded
68 messages Options
1234
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStore and I...

qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2589
 
    Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6509/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStore and I...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2589
 
    SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/6167/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStor...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user ajithme commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2589#discussion_r207721786
 
    --- Diff: store/core/src/main/java/org/apache/carbondata/store/impl/master/RegistryServiceImpl.java ---
    @@ -20,14 +20,14 @@
     import java.io.IOException;
     
     import org.apache.carbondata.common.annotations.InterfaceAudience;
    -import org.apache.carbondata.store.impl.rpc.RegistryService;
    -import org.apache.carbondata.store.impl.rpc.model.RegisterWorkerRequest;
    -import org.apache.carbondata.store.impl.rpc.model.RegisterWorkerResponse;
    +import org.apache.carbondata.store.impl.service.RegistryService;
    +import org.apache.carbondata.store.impl.service.model.RegisterWorkerRequest;
    +import org.apache.carbondata.store.impl.service.model.RegisterWorkerResponse;
     
     import org.apache.hadoop.ipc.ProtocolSignature;
     
     @InterfaceAudience.Internal
    -class RegistryServiceImpl implements RegistryService {
    +class egistryServiceImpl implements RegistryService {
    --- End diff --
   
    typo, pls rename


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStor...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user ajithme commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2589#discussion_r207721977
 
    --- Diff: store/core/src/main/java/org/apache/carbondata/store/impl/MetaOperation.java ---
    @@ -145,26 +152,61 @@ private void createTable(TableInfo tableInfo, boolean ifNotExists) throws IOExce
         }
       }
     
    -  public void dropTable(TableIdentifier table) throws IOException {
    -    String tablePath = store.getTablePath(table.getTableName(), table.getDatabaseName());
    +  public void dropTable(TableIdentifier table) throws CarbonException {
    +    String tablePath = getTablePath(table.getTableName(), table.getDatabaseName());
         cache.remove(tablePath);
    -    FileFactory.deleteFile(tablePath);
    +    try {
    +      FileFactory.deleteFile(tablePath);
    +    } catch (IOException e) {
    +      throw new CarbonException(e);
    +    }
    +  }
    +
    +  public TableInfo getTable(TableIdentifier table) throws CarbonException {
    +    return getTable(table, storeConf);
       }
     
    -  public CarbonTable getTable(TableIdentifier table) throws IOException {
    -    String tablePath = store.getTablePath(table.getTableName(), table.getDatabaseName());
    +  public static TableInfo getTable(TableIdentifier table, StoreConf storeConf)
    +      throws CarbonException {
    +    String tablePath = getTablePath(table.getTableName(), table.getDatabaseName(), storeConf);
         if (cache.containsKey(tablePath)) {
           return cache.get(tablePath);
         } else {
    -      org.apache.carbondata.format.TableInfo formatTableInfo =
    -          CarbonUtil.readSchemaFile(CarbonTablePath.getSchemaFilePath(tablePath));
    +      org.apache.carbondata.format.TableInfo formatTableInfo = null;
    +      try {
    +        formatTableInfo = CarbonUtil.readSchemaFile(CarbonTablePath.getSchemaFilePath(tablePath));
    +      } catch (IOException e) {
    +        throw new CarbonException(e);
    +      }
           SchemaConverter schemaConverter = new ThriftWrapperSchemaConverterImpl();
           TableInfo tableInfo = schemaConverter.fromExternalToWrapperTableInfo(
               formatTableInfo, table.getDatabaseName(), table.getTableName(), tablePath);
           tableInfo.setTablePath(tablePath);
    -      CarbonTable carbonTable = CarbonTable.buildFromTableInfo(tableInfo);
    -      cache.put(tablePath, carbonTable);
    -      return carbonTable;
    +      cache.put(tablePath, tableInfo);
    +      return tableInfo;
         }
       }
    -}
    \ No newline at end of file
    +
    +  public List<TableDescriptor> listTable() throws CarbonException {
    +    throw new UnsupportedOperationException();
    +  }
    +
    +  public TableDescriptor getDescriptor(TableIdentifier table) throws CarbonException {
    +    throw new UnsupportedOperationException();
    +  }
    +
    +  public void alterTable(TableIdentifier table, TableDescriptor newTable) throws CarbonException {
    +    throw new UnsupportedOperationException();
    +  }
    +
    +  public String getTablePath(String tableName, String databaseName) {
    +    Objects.requireNonNull(tableName);
    +    Objects.requireNonNull(databaseName);
    +    return String.format("%s/%s", storeConf.storeLocation(), tableName);
    +  }
    +  public static String getTablePath(String tableName, String databaseName, StoreConf storeConf) {
    +    Objects.requireNonNull(tableName);
    +    Objects.requireNonNull(databaseName);
    +    return String.format("%s/%s", storeConf.storeLocation(), tableName);
    --- End diff --
   
    must consider database name in path


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStore and I...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2589
 
    Build Failed  with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7787/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStore and I...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2589
 
    SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/6168/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStore and I...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2589
 
    Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6512/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2589: [CARBONDATA-2825][CARBONDATA-2828] CarbonStor...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user jackylk closed the pull request at:

    https://github.com/apache/carbondata/pull/2589


---
1234