Login  Register

Re: Discussing to add carbondata-tools module

Posted by Vimal Das Kammath on Aug 05, 2016; 9:33am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussing-to-add-carbondata-tools-module-tp4p15.html

+1
On Aug 5, 2016 2:45 PM, "Jean-Baptiste Onofré" <[hidden email]> wrote:

> I guess it's where we can put the checkstyle, ... (what we have in the dev
> folder right now), correct ?
>
> Regards
> JB
>
> On 08/05/2016 08:31 AM, QiangCai wrote:
>
>> Hi all,
>>
>>   To improve the CarbonData system's usability and maintainability, I
>> suggest to add carbondata-tools module.
>>   I think this module should provide some command tools as following.
>>
>>   1. import
>>   import a data file/folder to any existing table
>>
>>   2. export
>>   export the given columns to a file
>>
>>   3. schema
>>   show the detail information of the specified table schema file
>>
>>   4. metadata
>>   show tablestatus metadata
>>   show the history track for dataloading and compaction
>>
>>   5. footer
>>   show blocklet metadata list
>>   show start/end key, min/max value, row number, total size  for the
>> specified blocklet
>>
>>   6. blocklet
>>   show blocket list
>>   show blocket data, RLE map, Inverted index for the given columns
>>
>>   7. index
>>   show BTree node list
>>   show node information:start/end key, min/max value)
>>
>>   8. dictionary
>>   show  key-value list of specified gloabl/local dictionary file
>>   show sort index
>>   show dictionary metadata
>>
>> Thank you and look forward to having your opinion on this carbon-tools
>> module.
>>
>> David Cai
>>
>>
>>
>> --
>> View this message in context: http://apache-carbondata-maili
>> ng-list-archive.1130556.n5.nabble.com/Discussing-to-add-
>> carbondata-tools-module-tp4.html
>> Sent from the Apache CarbonData Mailing List archive mailing list archive
>> at Nabble.com.
>>
>>
> --
> Jean-Baptiste Onofré
> [hidden email]
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>