[DISCUSSION] Support only spark 2 in carbon 1.3.0

[lionel061201]

Hi community,
Currently we have three spark related module in carbondata(spark 1.5, 1.6,
2.1), the project has become more and more difficult to maintain and has
many redundant code.
I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
That will keep the project clean and simple for maintenance.
Maybe we can provide some key patch to old version. But new features could
support spark2 only.
Any ideas?


Thanks & Regards,
Lionel Cao

[cenyuhai11]

+1


Best regards!
Yuhai Cen


在2017年10月9日 09:56，Lu Cao<[hidden email]> 写道：
Hi community,
Currently we have three spark related module in carbondata(spark 1.5, 1.6,
2.1), the project has become more and more difficult to maintain and has
many redundant code.
I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
That will keep the project clean and simple for maintenance.
Maybe we can provide some key patch to old version. But new features could
support spark2 only.
Any ideas?


Thanks & Regards,
Lionel Cao

[Kunal Kapoor]

+1

On 09-Oct-2017 9:32 AM, "岑玉海" <[hidden email]> wrote:

> +1
>
>
> Best regards!
> Yuhai Cen
>
>
> 在2017年10月9日 09:56，Lu Cao<[hidden email]> 写道：
> Hi community,
> Currently we have three spark related module in carbondata(spark 1.5, 1.6,
> 2.1), the project has become more and more difficult to maintain and has
> many redundant code.
> I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
> That will keep the project clean and simple for maintenance.
> Maybe we can provide some key patch to old version. But new features could
> support spark2 only.
> Any ideas?
>
>
> Thanks & Regards,
> Lionel Cao
>

[phalodi]

+1

On Mon, Oct 9, 2017 at 1:35 PM, Kunal Kapoor <[hidden email]>
wrote:

> +1
>
> On 09-Oct-2017 9:32 AM, "岑玉海" <[hidden email]> wrote:
>
> > +1
> >
> >
> > Best regards!
> > Yuhai Cen
> >
> >
> > 在2017年10月9日 09:56，Lu Cao<[hidden email]> 写道：
> > Hi community,
> > Currently we have three spark related module in carbondata(spark 1.5,
> 1.6,
> > 2.1), the project has become more and more difficult to maintain and has
> > many redundant code.
> > I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
> > That will keep the project clean and simple for maintenance.
> > Maybe we can provide some key patch to old version. But new features
> could
> > support spark2 only.
> > Any ideas?
> >
> >
> > Thanks & Regards,
> > Lionel Cao
> >
>

[Suprith T Jain]

+1

On 09-Oct-2017 7:27 AM, "Lu Cao" <[hidden email]> wrote:

> Hi community,
> Currently we have three spark related module in carbondata(spark 1.5, 1.6,
> 2.1), the project has become more and more difficult to maintain and has
> many redundant code.
> I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
> That will keep the project clean and simple for maintenance.
> Maybe we can provide some key patch to old version. But new features could
> support spark2 only.
> Any ideas?
>
>
> Thanks & Regards,
> Lionel Cao
>

[manishgupta88]

+1

Regards
Manish Gupta

On Mon, 9 Oct 2017 at 5:11 PM, Suprith T Jain <[hidden email]> wrote:

> +1
>
> On 09-Oct-2017 7:27 AM, "Lu Cao" <[hidden email]> wrote:
>
> > Hi community,
> > Currently we have three spark related module in carbondata(spark 1.5,
> 1.6,
> > 2.1), the project has become more and more difficult to maintain and has
> > many redundant code.
> > I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
> > That will keep the project clean and simple for maintenance.
> > Maybe we can provide some key patch to old version. But new features
> could
> > support spark2 only.
> > Any ideas?
> >
> >
> > Thanks & Regards,
> > Lionel Cao
> >
>

[xm_zzc]

+1



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[gururajshetty]

+ 1

Regards,
Gururaj




--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[jarray888]

+1






On 10/10/2017 14:13, gururajshetty wrote:
+ 1

Regards,
Gururaj




--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[bhavya411]

+1

Regards
Bhavya

On Tue, Oct 10, 2017 at 7:15 PM, jarray <[hidden email]> wrote:

> +1
>
>
>
>
>
>
> On 10/10/2017 14:13, gururajshetty wrote:
> + 1
>
> Regards,
> Gururaj
>
>
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.
> n5.nabble.com/
>

[Liang Chen]

Hi lionel

As per mailing list discussion result, no objection. so can you create an
umbrella jira to remove spark 1.5 & 1.6 code in 1.3.0.

Regards
Liang


lionel061201 wrote

> Hi community,
> Currently we have three spark related module in carbondata(spark 1.5, 1.6,
> 2.1), the project has become more and more difficult to maintain and has
> many redundant code.
> I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
> That will keep the project clean and simple for maintenance.
> Maybe we can provide some key patch to old version. But new features could
> support spark2 only.
> Any ideas?
>
>
> Thanks & Regards,
> Lionel Cao

--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[lionel061201]

Sure, will create the Jira ticket.

Thanks,
Lionel

On Sun, Oct 15, 2017 at 2:29 PM, Liang Chen <[hidden email]> wrote:

> Hi lionel
>
> As per mailing list discussion result, no objection. so can you create an
> umbrella jira to remove spark 1.5 & 1.6 code in 1.3.0.
>
> Regards
> Liang
>
>
> lionel061201 wrote
> > Hi community,
> > Currently we have three spark related module in carbondata(spark 1.5,
> 1.6,
> > 2.1), the project has become more and more difficult to maintain and has
> > many redundant code.
> > I propose to stop supporting spark 1.5 &1.6 and focus on spark 2.1(2.2).
> > That will keep the project clean and simple for maintenance.
> > Maybe we can provide some key patch to old version. But new features
> could
> > support spark2 only.
> > Any ideas?
> >
> >
> > Thanks & Regards,
> > Lionel Cao
>
>
>
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.
> n5.nabble.com/
>

[geda]

+1

2017-10-15 21:19 GMT+08:00 Lu Cao <[hidden email]>:

> Sure, will create the Jira ticket.
>
> Thanks,
> Lionel
>
> On Sun, Oct 15, 2017 at 2:29 PM, Liang Chen <[hidden email]>
> wrote:
>
> > Hi lionel
> >
> > As per mailing list discussion result, no objection. so can you create an
> > umbrella jira to remove spark 1.5 & 1.6 code in 1.3.0.
> >
> > Regards
> > Liang
> >
> >
> > lionel061201 wrote
> > > Hi community,
> > > Currently we have three spark related module in carbondata(spark 1.5,
> > 1.6,
> > > 2.1), the project has become more and more difficult to maintain and
> has
> > > many redundant code.
> > > I propose to stop supporting spark 1.5 &1.6 and focus on spark
> 2.1(2.2).
> > > That will keep the project clean and simple for maintenance.
> > > Maybe we can provide some key patch to old version. But new features
> > could
> > > support spark2 only.
> > > Any ideas?
> > >
> > >
> > > Thanks & Regards,
> > > Lionel Cao
> >
> >
> >
> >
> >
> > --
> > Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.
> > n5.nabble.com/
> >
>