DISCUSSION: removing support for Spark 2.1 and 2.2 in CarbonData 2.0

[Jacky Li]

Hi,

For following reasons, I suggest to deprecate the support of spark 2.1 and
2.2 integration in CarbonData 2.0:

1. As spark community is moving to 3.0, versions below 2.3 will be out of
maintaining lifecycle in spark community.

2. In PR #3378 (Integrating with Spark 2.4.4), the carbondata-spark2 module
becomes very complex since new folder to extract out common code for Spark
2.4.4 is needed. To avoid these complexity, it is better to drop support for
2.1 and 2.2

3. We only have 2 set of CI environment (currently is for 2.2 and 2.3
integration), after we integrate with Spark 2.4, we do not have enough
resources to run for 2.2 integration.

What is your opinion.

Regards,
Jacky



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[Liang Chen]

OK from my side, +1

Regards
Liang



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[xm_zzc]

+1 from my side


Regards
Zhichao Zhang


------------------ Original ------------------
From:&nbsp;"Liang Chen [via Apache CarbonData Dev Mailing List archive]"<[hidden email]&gt;;
Date:&nbsp;Sun, Dec 22, 2019 09:12 PM
To:&nbsp;"恩爸"<[hidden email]&gt;;

Subject:&nbsp;Re: DISCUSSION: removing support for Spark 2.1 and 2.2 in CarbonData 2.0



  OK from my side, +1

Regards
Liang



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
 
 
 
  If you reply to this email, your message will be added to the discussion below:
  http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-removing-support-for-Spark-2-1-and-2-2-in-CarbonData-2-0-tp88549p88593.html 
  To start a new topic under Apache CarbonData Dev Mailing List archive, email [hidden email]
  To unsubscribe from Apache CarbonData Dev Mailing List archive, click here.
  NAML