Single Pass Data Load Design

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Single Pass Data Load Design

ravipesala
Hi All,

Please find the proposed solutions for single pass data load.

https://docs.google.com/document/d/1_sSN9lccCZo4E_X3pNP5PchQACqif3AOXKTuG-YJAcc/edit?usp=sharing
--
Thanks & Regards,
Ravindra
Reply | Threaded
Open this post in threaded view
|

Re: Single Pass Data Load Design

Jacky Li
Hi Ravindra,

Thanks for proposing this design. It is really exciting if CarbonData can do 1-pass solution for loading. I have given some comment in the design document.

Regards,
Jacky
Reply | Threaded
Open this post in threaded view
|

Re: Single Pass Data Load Design

Liang Chen
Administrator
Hi

Yes, good feature. This improvement would significantly improve data load
performance.
Can you provide a sequence diagram for the whole data load process?

Regards
Liang

2016-11-14 15:42 GMT+08:00 Jacky Li <[hidden email]>:

> Hi Ravindra,
>
> Thanks for proposing this design. It is really exciting if CarbonData can
> do
> 1-pass solution for loading. I have given some comment in the design
> document.
>
> Regards,
> Jacky
>
>
>
> --
> View this message in context: http://apache-carbondata-
> mailing-list-archive.1130556.n5.nabble.com/Single-Pass-
> Data-Load-Design-tp2875p2894.html
> Sent from the Apache CarbonData Mailing List archive mailing list archive
> at Nabble.com.
>



--
Regards
Liang
Reply | Threaded
Open this post in threaded view
|

RE: Single Pass Data Load Design

Jihong Ma
In reply to this post by ravipesala
Hi Ravindra,

Thank you for putting together a proposal for improving data load process!

Please find my comments in-lined in the Google doc.

Jihong

-----Original Message-----
From: Ravindra Pesala [mailto:[hidden email]]
Sent: Sunday, November 13, 2016 4:24 AM
To: dev
Subject: Single Pass Data Load Design

Hi All,

Please find the proposed solutions for single pass data load.

https://docs.google.com/document/d/1_sSN9lccCZo4E_X3pNP5PchQACqif3AOXKTuG-YJAcc/edit?usp=sharing
--
Thanks & Regards,
Ravindra