Hi All,
Based on further analysis with druid and influxdb, current design fails to cover the late data arrived to load. So i have updated the design document based on that to support late data and attached in jira. Please help to review it and suggestions are welcomed. Regards, Akash On 2019/09/23 13:42:48, Akash Nilugal <[hidden email]> wrote: > Hi Community, > > Timeseries data are simply measurements or events that are > tracked,monitored, downsampled, and aggregated over time. > Basicallytimeseries data analysis helps in analyzing or monitoring > theaggregated data over period of time to take better decision forbusiness. > So since carbondata supports olap datamap like preaggregate, MV and since > time series is of atmost importance, > we can supporttimeseries for carbondata over MV datamap model. > > Currentlycarbondata supports timeseries on preaggregate datamap, but its > analpha feature and there are so many limitations when we compare and > analyze the existing timeseries database or projects which supportstime > series like apache druid or influxdb. So, in this feature we can support > timeseries > by avoiding the limitations in the current system. After doing the analysis > on the current existing timeseries database like influxdb, and the apache > druid, > i have prepared a solution/design document. Any inputs, improvements or > suggestion are most welcome. > > I have created jira https://issues.apache.org/jira/browse/CARBONDATA-3525 for > this. Later i will create sub jiras for tracking. > > > Regards, > Akash R Nilugal > |
+1
-Regards Kumar Vishal On Mon, Oct 21, 2019 at 5:46 PM Akash Nilugal <[hidden email]> wrote: > Hi All, > > Based on further analysis with druid and influxdb, current design fails to > cover the late data arrived to load. So i have updated the design document > based on that to support late data and attached in jira. Please help to > review it and suggestions are welcomed. > > Regards, > Akash > > On 2019/09/23 13:42:48, Akash Nilugal <[hidden email]> wrote: > > Hi Community, > > > > Timeseries data are simply measurements or events that are > > tracked,monitored, downsampled, and aggregated over time. > > Basicallytimeseries data analysis helps in analyzing or monitoring > > theaggregated data over period of time to take better decision > forbusiness. > > So since carbondata supports olap datamap like preaggregate, MV and since > > time series is of atmost importance, > > we can supporttimeseries for carbondata over MV datamap model. > > > > Currentlycarbondata supports timeseries on preaggregate datamap, but its > > analpha feature and there are so many limitations when we compare and > > analyze the existing timeseries database or projects which supportstime > > series like apache druid or influxdb. So, in this feature we can support > > timeseries > > by avoiding the limitations in the current system. After doing the > analysis > > on the current existing timeseries database like influxdb, and the apache > > druid, > > i have prepared a solution/design document. Any inputs, improvements or > > suggestion are most welcome. > > > > I have created jira > https://issues.apache.org/jira/browse/CARBONDATA-3525 for > > this. Later i will create sub jiras for tracking. > > > > > > Regards, > > Akash R Nilugal > > >
kumar vishal
|
+1
Regards Kunal Kapoor On Mon, Nov 18, 2019, 3:47 PM Kumar Vishal <[hidden email]> wrote: > +1 > -Regards > Kumar Vishal > > On Mon, Oct 21, 2019 at 5:46 PM Akash Nilugal <[hidden email]> > wrote: > > > Hi All, > > > > Based on further analysis with druid and influxdb, current design fails > to > > cover the late data arrived to load. So i have updated the design > document > > based on that to support late data and attached in jira. Please help to > > review it and suggestions are welcomed. > > > > Regards, > > Akash > > > > On 2019/09/23 13:42:48, Akash Nilugal <[hidden email]> wrote: > > > Hi Community, > > > > > > Timeseries data are simply measurements or events that are > > > tracked,monitored, downsampled, and aggregated over time. > > > Basicallytimeseries data analysis helps in analyzing or monitoring > > > theaggregated data over period of time to take better decision > > forbusiness. > > > So since carbondata supports olap datamap like preaggregate, MV and > since > > > time series is of atmost importance, > > > we can supporttimeseries for carbondata over MV datamap model. > > > > > > Currentlycarbondata supports timeseries on preaggregate datamap, but > its > > > analpha feature and there are so many limitations when we compare and > > > analyze the existing timeseries database or projects which supportstime > > > series like apache druid or influxdb. So, in this feature we can > support > > > timeseries > > > by avoiding the limitations in the current system. After doing the > > analysis > > > on the current existing timeseries database like influxdb, and the > apache > > > druid, > > > i have prepared a solution/design document. Any inputs, improvements > or > > > suggestion are most welcome. > > > > > > I have created jira > > https://issues.apache.org/jira/browse/CARBONDATA-3525 for > > > this. Later i will create sub jiras for tracking. > > > > > > > > > Regards, > > > Akash R Nilugal > > > > > > |
Free forum by Nabble | Edit this page |