[jira] [Created] (CARBONDATA-3431) CSDK Performance , Batch reader is not improved the performance.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3431) CSDK Performance , Batch reader is not improved the performance.

Akash R Nilugal (Jira)
Babulal created CARBONDATA-3431:
-----------------------------------

             Summary: CSDK Performance , Batch reader is not improved the performance.
                 Key: CARBONDATA-3431
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3431
             Project: CarbonData
          Issue Type: Bug
            Reporter: Babulal


create Carbon Reader program (attached and run with batch size ) 

./CJDK /data1/project/carbon_data/ true true 4096 1> 1.log 2 >batch_4096.log

./CJDK /data1/project/carbon_data/ true true 50000 1> 1.log 2 >batch_5000.log

Test 1:- Vector =True ,Batch =True ,Batch size =4096

Result :- total line is: 14619150,  build time is: 0.812358 s, read time is 8.013806 s, average speed is 1824245.558228 records/s  


Test 2 :- Vector =True ,Batch =True ,Batch Size =5000

Result :- total line is: 14619150,  build time is: 0.835605 s, read time is 7.948390 s, average speed is 1839259.271374 records/s 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)