[ANNOUNCE] Apache CarbonData 1.4.1 release

[ravipesala]

Hi,


Apache CarbonData community is pleased to announce the release of the
Version 1.4.1 in The Apache Software Foundation (ASF).

CarbonData is a high-performance data solution that supports various data
analytic scenarios, including BI analysis, ad-hoc SQL query, fast filter
lookups on detail record, streaming analytics, etc. CarbonData has been
deployed in many enterprise production environments, in one of the largest
scenarios, it supports queries on a single table with 3PB data (more than 5
trillion records)  with response time less than 3 seconds!

We encourage you to use the release
https://dist.apache.org/repos/dist/release/carbondata/1.4.1/, and feedback
through the CarbonData user mailing lists <[hidden email]>!

This release note provides information on the new features, improvements,
and bug fixes of this release.
What’s New in Version 1.4.1?

In this version of CarbonData, more than 230 JIRA tickets for new feature,
improvement and bugs has been resolved. Following are the summary.
Carbon CoreSupport Cloud Storage (S3)

This can be used to store or retrieve data on Amazon cloud, Huawei
Cloud(OBS) or on any other object stores conforming to S3 API. Storing data
in cloud is advantageous as there are no restrictions on the size of data
and the data can be accessed from anywhere at any time. Carbondata can
support any Object Storage that conforms to Amazon S3 API.  For more
detail, please refer to S3 Guide
<https://github.com/apache/carbondata/blob/master/docs/s3-guide.md>.
Support Flat Folder

This feature allows all carbondata and index files to keep directly under
table-path. This is useful for interoperability between the execution
engines and plugin with other execution engines like Hive or Presto.
Support 32K Characters (Alpha Feature)

In common scenarios, the length of the string is less than 32000. In some
cases, if the length of the string is more than 32000 characters,
CarbonData introduces a table property called LONG_STRING_COLUMNS to handle
this scenario. For these columns, CarbonData internally stores the length
of content using Integer.
Local Dictionary

Helps in getting more compression. Filter queries and full scan queries
will be faster as filter will be done on encoded data. Reducing the store
size and memory footprint as only unique values will be stored as part of
local dictionary and corresponding data will be stored as encoded
data. Getting higher IO throughput.
Merge Index

CarbonData supports merging of all the index files inside a segment to a
single CarbonData index merge file. This enhances the first query
performance.
Shows History Segments

CarbonData introduces a 'SHOW HISTORY SEGMENTS' to show all segment
information including visible and invisible segments.
Custom Compaction

Custom compaction is a new compaction type in addition to MAJOR and MINOR
compaction. In custom compaction, you can directly specify the segment ids
to be merged.
Enhancement for Detail Record AnalysisSupports Bloom Filter DataMap

CarbonData introduces BloomFilter as an index datamap to enhance the
performance of querying with precise value. It is well suitable for queries
that do precise match on high cardinality columns(such as Name/ID). In
concurrent filter query scenario (on high cardinality column), we observe
3~5 times improvement in concurrent queries per second comparing to last
version. For more detail, please refer to BloomFilter DataMap Guide
<https://github.com/apache/carbondata/blob/master/docs/datamap/bloomfilter-datamap-guide.md>
.
Improved Complex Datatypes

Improved complex datatypes compression and performance through adaptive
encoding.


Please find the detailed JIRA list:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12343148

New Feature

   - [CARBONDATA-2504
   <https://issues.apache.org/jira/browse/CARBONDATA-2504>] - Support
   StreamSQL for streaming job
   - [CARBONDATA-2638
   <https://issues.apache.org/jira/browse/CARBONDATA-2638>] - Implement
   driver min max caching for specified columns and segregate block and
   blocklet cache

Improvement

   - [CARBONDATA-2202
   <https://issues.apache.org/jira/browse/CARBONDATA-2202>] - Introduce
   local dictionary encoding for dimensions
   - [CARBONDATA-2309
   <https://issues.apache.org/jira/browse/CARBONDATA-2309>] - Add strategy
   to generate bigger carbondata files in case of small amount of data
   - [CARBONDATA-2355
   <https://issues.apache.org/jira/browse/CARBONDATA-2355>] - Support run
   SQL on carbon files directly, which is generated by SDk
   - [CARBONDATA-2389
   <https://issues.apache.org/jira/browse/CARBONDATA-2389>] - Search mode
   support lucene datamap
   - [CARBONDATA-2420
   <https://issues.apache.org/jira/browse/CARBONDATA-2420>] - Support
   string longer than 32000 characters
   - [CARBONDATA-2428
   <https://issues.apache.org/jira/browse/CARBONDATA-2428>] - Support Flat
   folder structure in carbon.
   - [CARBONDATA-2482
   <https://issues.apache.org/jira/browse/CARBONDATA-2482>] - Pass uuid
   while writing segment file if possible
   - [CARBONDATA-2500
   <https://issues.apache.org/jira/browse/CARBONDATA-2500>] - The order is
   different between write and read data type of schema in SDK
   - [CARBONDATA-2519
   <https://issues.apache.org/jira/browse/CARBONDATA-2519>] - Add document
   for CarbonReader
   - [CARBONDATA-2521
   <https://issues.apache.org/jira/browse/CARBONDATA-2521>] - Support
   create carbonReader without tableName
   - [CARBONDATA-2549
   <https://issues.apache.org/jira/browse/CARBONDATA-2549>] - Implement LRU
   cache in Bloom filter based on Carbon LRU cache interface
   - [CARBONDATA-2553
   <https://issues.apache.org/jira/browse/CARBONDATA-2553>] - support ZSTD
   compression for sort temp file
   - [CARBONDATA-2558
   <https://issues.apache.org/jira/browse/CARBONDATA-2558>] - Optimize
   carbon schema reader interface of SDK
   - [CARBONDATA-2569
   <https://issues.apache.org/jira/browse/CARBONDATA-2569>] - Search mode
   throw exception but test case pass
   - [CARBONDATA-2573
   <https://issues.apache.org/jira/browse/CARBONDATA-2573>] - Merge
   carbonstore branch to master
   - [CARBONDATA-2575
   <https://issues.apache.org/jira/browse/CARBONDATA-2575>] - Add document
   to explain DataMap Management
   - [CARBONDATA-2591
   <https://issues.apache.org/jira/browse/CARBONDATA-2591>] - SDK
   CarbonReader support filter
   - [CARBONDATA-2593
   <https://issues.apache.org/jira/browse/CARBONDATA-2593>] - Add an option
   'carbon.insert.storage.level' to support configuring the storage level when
   insert into data with 'carbon.insert.persist.enable'='true'
   - [CARBONDATA-2609
   <https://issues.apache.org/jira/browse/CARBONDATA-2609>] - Change RPC
   implementation to Hadoop RPC
   - [CARBONDATA-2630
   <https://issues.apache.org/jira/browse/CARBONDATA-2630>] - Alter table
   set Table comment is throwing exception in spark-2.2 cluster
   - [CARBONDATA-2642
   <https://issues.apache.org/jira/browse/CARBONDATA-2642>] - Introduce
   configurable Lock Path
   - [CARBONDATA-2656
   <https://issues.apache.org/jira/browse/CARBONDATA-2656>] - Presto Stream
   Readers performance Enhancement
   - [CARBONDATA-2659
   <https://issues.apache.org/jira/browse/CARBONDATA-2659>] - Support
   partitioned carbon table by DataFrame.write
   - [CARBONDATA-2686
   <https://issues.apache.org/jira/browse/CARBONDATA-2686>] - Implement
   left outer join in mv
   - [CARBONDATA-2710
   <https://issues.apache.org/jira/browse/CARBONDATA-2710>] - Refactor
   CarbonSparkSqlParser for better code reuse.
   - [CARBONDATA-2720
   <https://issues.apache.org/jira/browse/CARBONDATA-2720>] - Remove dead
   code from carbonData
   - [CARBONDATA-2754
   <https://issues.apache.org/jira/browse/CARBONDATA-2754>] - fix failing
   UT for HiveMetastore
   - [CARBONDATA-2760
   <https://issues.apache.org/jira/browse/CARBONDATA-2760>] - Reduce Memory
   footprint and store size for local dictionary encoded columns
   - [CARBONDATA-2782
   <https://issues.apache.org/jira/browse/CARBONDATA-2782>] - dead code in
   class 'CarbonCleanFilesCommand'
   - [CARBONDATA-2791
   <https://issues.apache.org/jira/browse/CARBONDATA-2791>] - Fix Adaptive
   Encoding for Double if exceeds LONG.Max_value
   - [CARBONDATA-2801
   <https://issues.apache.org/jira/browse/CARBONDATA-2801>] - Add
   documentation for flat folder
   - [CARBONDATA-2807
   <https://issues.apache.org/jira/browse/CARBONDATA-2807>] - Fixed data
   load performance issue with more number of records
   - [CARBONDATA-2815
   <https://issues.apache.org/jira/browse/CARBONDATA-2815>] - Add
   documentation for memory spill and rebuild datamap
   - [CARBONDATA-2836
   <https://issues.apache.org/jira/browse/CARBONDATA-2836>] - Fixed data
   loading performance issue

Test

   - [CARBONDATA-2481
   <https://issues.apache.org/jira/browse/CARBONDATA-2481>] - Adding SDV
   testcases for SDK Writer

Task

   - [CARBONDATA-2789
   <https://issues.apache.org/jira/browse/CARBONDATA-2789>] - Support
   Hadoop 2.8.3 eco-system integration

Sub-task

   - [CARBONDATA-2512
   <https://issues.apache.org/jira/browse/CARBONDATA-2512>] - Support
   long_string_columns in sdk
   - [CARBONDATA-2587
   <https://issues.apache.org/jira/browse/CARBONDATA-2587>] - Support Local
   dictionary in data loading
   - [CARBONDATA-2589
   <https://issues.apache.org/jira/browse/CARBONDATA-2589>] - Support Query
   on Local dictionary columns
   - [CARBONDATA-2590
   <https://issues.apache.org/jira/browse/CARBONDATA-2590>] - Support Query
   on Local dictionary Complex type column
   - [CARBONDATA-2602
   <https://issues.apache.org/jira/browse/CARBONDATA-2602>] - Support
   Filter Query on Local dictionary generated columns
   - [CARBONDATA-2606
   <https://issues.apache.org/jira/browse/CARBONDATA-2606>] - Projection
   push down for struct data type
   - [CARBONDATA-2607
   <https://issues.apache.org/jira/browse/CARBONDATA-2607>] - Provide
   Adaptive Encoding and Decoding for all data type
   - [CARBONDATA-2608
   <https://issues.apache.org/jira/browse/CARBONDATA-2608>] - SDK Support
   JSON data loading directly without AVRO conversion
   - [CARBONDATA-2618
   <https://issues.apache.org/jira/browse/CARBONDATA-2618>] - Split to
   multiple pages if varchar column page exceeds 2GB/snappy limits
   - [CARBONDATA-2624
   <https://issues.apache.org/jira/browse/CARBONDATA-2624>] - Add
   validations for Create table command for complex dataType columns for Local
   Dictionary Support
   - [CARBONDATA-2633
   <https://issues.apache.org/jira/browse/CARBONDATA-2633>] - Bugs are
   found when bloomindex column is dictionary/sort/date column
   - [CARBONDATA-2634
   <https://issues.apache.org/jira/browse/CARBONDATA-2634>] - Provide more
   information about the datamap when showing datamaps
   - [CARBONDATA-2635
   <https://issues.apache.org/jira/browse/CARBONDATA-2635>] - Support
   different provider based index datamaps on same column
   - [CARBONDATA-2637
   <https://issues.apache.org/jira/browse/CARBONDATA-2637>] - Fix bugs for
   deferred rebuild for bloomfilter datamap
   - [CARBONDATA-2645
   <https://issues.apache.org/jira/browse/CARBONDATA-2645>] - Segregate
   block and blocklet cache
   - [CARBONDATA-2647
   <https://issues.apache.org/jira/browse/CARBONDATA-2647>] - Add support
   for CACHE_LEVEL in create table and alter table properties
   - [CARBONDATA-2648
   <https://issues.apache.org/jira/browse/CARBONDATA-2648>] - Add support
   for COLUMN_META_CACHE in create table and alter table properties
   - [CARBONDATA-2649
   <https://issues.apache.org/jira/browse/CARBONDATA-2649>] - Add code for
   caching min/max only for specified columns
   - [CARBONDATA-2650
   <https://issues.apache.org/jira/browse/CARBONDATA-2650>] - explain query
   shows negative skipped blocklets for bloomfilter datamap
   - [CARBONDATA-2651
   <https://issues.apache.org/jira/browse/CARBONDATA-2651>] - Update IDG
   for COLUMN_META_CACHE and CACHE_LEVEL properties
   - [CARBONDATA-2653
   <https://issues.apache.org/jira/browse/CARBONDATA-2653>] - Fix bugs in
   incorrect blocklet number in bloomfilter
   - [CARBONDATA-2654
   <https://issues.apache.org/jira/browse/CARBONDATA-2654>] - Optimize
   output for explaining query with datamap
   - [CARBONDATA-2655
   <https://issues.apache.org/jira/browse/CARBONDATA-2655>] - Support `in`
   operator for bloomfilter datamap
   - [CARBONDATA-2657
   <https://issues.apache.org/jira/browse/CARBONDATA-2657>] -
   Loading/Filtering empty value fails on bloom index columns
   - [CARBONDATA-2660
   <https://issues.apache.org/jira/browse/CARBONDATA-2660>] - Support
   filtering on longstring bloom index columns
   - [CARBONDATA-2675
   <https://issues.apache.org/jira/browse/CARBONDATA-2675>] - Support
   config long_string_columns when create datamap
   - [CARBONDATA-2681
   <https://issues.apache.org/jira/browse/CARBONDATA-2681>] - Fix loading
   problem using global/batch sort fails when table has long string columns
   - [CARBONDATA-2682
   <https://issues.apache.org/jira/browse/CARBONDATA-2682>] - create table
   with long_string_columns property
   - [CARBONDATA-2683
   <https://issues.apache.org/jira/browse/CARBONDATA-2683>] - Fix data
   convertion problem for Varchar
   - [CARBONDATA-2685
   <https://issues.apache.org/jira/browse/CARBONDATA-2685>] - make datamap
   rebuild for all segments in parallel
   - [CARBONDATA-2687
   <https://issues.apache.org/jira/browse/CARBONDATA-2687>] - update
   document for bloomfilter
   - [CARBONDATA-2689
   <https://issues.apache.org/jira/browse/CARBONDATA-2689>] - Add test
   cases for alter statement for Local Dictionary Support and add validations
   for complex data Type columns
   - [CARBONDATA-2693
   <https://issues.apache.org/jira/browse/CARBONDATA-2693>] - Fix bug for
   alter rename is renameing the existing table on which bloomfilter datamp
   exists
   - [CARBONDATA-2694
   <https://issues.apache.org/jira/browse/CARBONDATA-2694>] - show
   long_string_columns in desc table command
   - [CARBONDATA-2700
   <https://issues.apache.org/jira/browse/CARBONDATA-2700>] - Block
   dropping index columns for index datamap
   - [CARBONDATA-2701
   <https://issues.apache.org/jira/browse/CARBONDATA-2701>] - Refactor code
   to store minimal required info in Block and Blocklet Cache
   - [CARBONDATA-2702
   <https://issues.apache.org/jira/browse/CARBONDATA-2702>] - Fix bugs in
   clear bloom datamap
   - [CARBONDATA-2706
   <https://issues.apache.org/jira/browse/CARBONDATA-2706>] - clear bloom
   index file after segment is deleted
   - [CARBONDATA-2708
   <https://issues.apache.org/jira/browse/CARBONDATA-2708>] - clear index
   file if dataloading is failed
   - [CARBONDATA-2714
   <https://issues.apache.org/jira/browse/CARBONDATA-2714>] - Support merge
   index files for the segment
   - [CARBONDATA-2716
   <https://issues.apache.org/jira/browse/CARBONDATA-2716>] - Add validate
   for datamap writer while loading data
   - [CARBONDATA-2719
   <https://issues.apache.org/jira/browse/CARBONDATA-2719>] - Table
   update/delete is needed block on table having datamaps
   - [CARBONDATA-2723
   <https://issues.apache.org/jira/browse/CARBONDATA-2723>] - Failed to
   recreate the table which has bloomfilter on it with same table name but
   different bloom index
   - [CARBONDATA-2727
   <https://issues.apache.org/jira/browse/CARBONDATA-2727>] - Support
   create bloom datamap on newly added column
   - [CARBONDATA-2732
   <https://issues.apache.org/jira/browse/CARBONDATA-2732>] - Block create
   bloomfilter datamap index on column which its datatype is complex type
   - [CARBONDATA-2734
   <https://issues.apache.org/jira/browse/CARBONDATA-2734>] - [BUG] support
   struct of date in create table
   - [CARBONDATA-2745
   <https://issues.apache.org/jira/browse/CARBONDATA-2745>] - Add a
   seperate Impl for AtomicFileOperations for s3
   - [CARBONDATA-2746
   <https://issues.apache.org/jira/browse/CARBONDATA-2746>] - Fix bug for
   getting datamap file when table has multiple datamaps
   - [CARBONDATA-2757
   <https://issues.apache.org/jira/browse/CARBONDATA-2757>] - Fix bug when
   building bloomfilter on measure column
   - [CARBONDATA-2770
   <https://issues.apache.org/jira/browse/CARBONDATA-2770>] - Optimize code
   to get blocklet id when rebuilding datamap
   - [CARBONDATA-2774
   <https://issues.apache.org/jira/browse/CARBONDATA-2774>] - Exception
   should be thrown if expression do not satisfy bloomFilter's requirement
   - [CARBONDATA-2783
   <https://issues.apache.org/jira/browse/CARBONDATA-2783>] - Update
   document of bloom filter datamap
   - [CARBONDATA-2788
   <https://issues.apache.org/jira/browse/CARBONDATA-2788>] - Fix bugs in
   incorrect query result with bloom datamap
   - [CARBONDATA-2790
   <https://issues.apache.org/jira/browse/CARBONDATA-2790>] - Optimize
   default parameter for bloomfilter datamap
   - [CARBONDATA-2793
   <https://issues.apache.org/jira/browse/CARBONDATA-2793>] - Add document
   for 32k feature
   - [CARBONDATA-2796
   <https://issues.apache.org/jira/browse/CARBONDATA-2796>] - Fix data
   loading problem when table has complex column and long string column
   - [CARBONDATA-2800
   <https://issues.apache.org/jira/browse/CARBONDATA-2800>] - Add useful
   tips for bloomfilter datamap

Bug

   - [CARBONDATA-1787
   <https://issues.apache.org/jira/browse/CARBONDATA-1787>] - Carbon 1.3.0-
   Global Sort: Global_Sort_Partitions parameter doesn't work, if specified in
   the Tblproperties, while creating the table.
   - [CARBONDATA-2339
   <https://issues.apache.org/jira/browse/CARBONDATA-2339>] - 下标越界
   - [CARBONDATA-2340
   <https://issues.apache.org/jira/browse/CARBONDATA-2340>] -
   load数据超过32000byte
   - [CARBONDATA-2418
   <https://issues.apache.org/jira/browse/CARBONDATA-2418>] - Presto can't
   query Carbon table when carbonstore is created at s3
   - [CARBONDATA-2478
   <https://issues.apache.org/jira/browse/CARBONDATA-2478>] - Add
   datamap-developer-guide.md file in readme
   - [CARBONDATA-2491
   <https://issues.apache.org/jira/browse/CARBONDATA-2491>] - There are
   some error when reader twice with SDK carbonReader
   - [CARBONDATA-2508
   <https://issues.apache.org/jira/browse/CARBONDATA-2508>] - There are
   some errors when I running SearchModeExample
   - [CARBONDATA-2514
   <https://issues.apache.org/jira/browse/CARBONDATA-2514>] - Duplicate
   columns in CarbonWriter is throwing NullPointerException
   - [CARBONDATA-2515
   <https://issues.apache.org/jira/browse/CARBONDATA-2515>] - Filter OR
   Expression not working properly in Presto integration
   - [CARBONDATA-2516
   <https://issues.apache.org/jira/browse/CARBONDATA-2516>] - Filter
   Greater-than for timestamp datatype not generating Expression in
   PrestoFilterUtil
   - [CARBONDATA-2528
   <https://issues.apache.org/jira/browse/CARBONDATA-2528>] - MV Datamap -
   When the MV is created with the order by, then when we execute the
   corresponding query defined in MV with order by, then the data is not
   accessed from the MV.
   - [CARBONDATA-2529
   <https://issues.apache.org/jira/browse/CARBONDATA-2529>] - S3 Example
   not working with Hadoop 2.8.3
   - [CARBONDATA-2530
   <https://issues.apache.org/jira/browse/CARBONDATA-2530>] - [MV] Wrong
   data displayed when parent table data are loaded
   - [CARBONDATA-2531
   <https://issues.apache.org/jira/browse/CARBONDATA-2531>] - [MV] MV not
   hit when alias is in use
   - [CARBONDATA-2534
   <https://issues.apache.org/jira/browse/CARBONDATA-2534>] - MV Dataset -
   MV creation is not working with the substring()
   - [CARBONDATA-2539
   <https://issues.apache.org/jira/browse/CARBONDATA-2539>] - MV Dataset -
   Subqueries is not accessing the data from the MV datamap.
   - [CARBONDATA-2540
   <https://issues.apache.org/jira/browse/CARBONDATA-2540>] - MV Dataset -
   Unionall queries are not fetching data from MV dataset.
   - [CARBONDATA-2542
   <https://issues.apache.org/jira/browse/CARBONDATA-2542>] - MV creation
   is failed for other than default database
   - [CARBONDATA-2546
   <https://issues.apache.org/jira/browse/CARBONDATA-2546>] - It will throw
   exception when give same column twice in projection and tries to print it.
   - [CARBONDATA-2550
   <https://issues.apache.org/jira/browse/CARBONDATA-2550>] - [MV] Limit is
   ignored when data fetched from MV, Query rewrite is Wrong
   - [CARBONDATA-2557
   <https://issues.apache.org/jira/browse/CARBONDATA-2557>] - Improve
   Carbon Reader Schema reading performance on S3
   - [CARBONDATA-2560
   <https://issues.apache.org/jira/browse/CARBONDATA-2560>] - [MV]
   Exception in console during MV creation but MV registered successfully
   - [CARBONDATA-2568
   <https://issues.apache.org/jira/browse/CARBONDATA-2568>] - [MV] MV
   datamap is not hit when ,column is in group by but not in projection
   - [CARBONDATA-2571
   <https://issues.apache.org/jira/browse/CARBONDATA-2571>] - Calculating
   the carbonindex and carbondata file size of a table is wrong
   - [CARBONDATA-2576
   <https://issues.apache.org/jira/browse/CARBONDATA-2576>] - MV Datamap -
   MV is not working fine if there is more than 3 aggregate function in the
   same datamap.
   - [CARBONDATA-2604
   <https://issues.apache.org/jira/browse/CARBONDATA-2604>] - getting
   ArrayIndexOutOfBoundException during compaction after IUD in cluster
   - [CARBONDATA-2614
   <https://issues.apache.org/jira/browse/CARBONDATA-2614>] - There are
   some exception when using FG in search mode and the prune result is none
   - [CARBONDATA-2616
   <https://issues.apache.org/jira/browse/CARBONDATA-2616>] - Incorrect
   explain and query result while using bloomfilter datamap
   - [CARBONDATA-2617
   <https://issues.apache.org/jira/browse/CARBONDATA-2617>] - Invalid tuple
   and block id getting formed for non partition table
   - [CARBONDATA-2621
   <https://issues.apache.org/jira/browse/CARBONDATA-2621>] - Lock problem
   in index datamap
   - [CARBONDATA-2623
   <https://issues.apache.org/jira/browse/CARBONDATA-2623>] - Add DataMap
   Pre and Pevent listener
   - [CARBONDATA-2626
   <https://issues.apache.org/jira/browse/CARBONDATA-2626>] - Logic for
   dictionary/nodictionary column pages in TablePage is wrong
   - [CARBONDATA-2627
   <https://issues.apache.org/jira/browse/CARBONDATA-2627>] - remove
   dependecy of tech.allegro.schema.json2avro
   - [CARBONDATA-2629
   <https://issues.apache.org/jira/browse/CARBONDATA-2629>] - SDK carbon
   reader don't support filter in HDFS and S3
   - [CARBONDATA-2632
   <https://issues.apache.org/jira/browse/CARBONDATA-2632>] - BloomFilter
   DataMap Bugs and Optimization
   - [CARBONDATA-2644
   <https://issues.apache.org/jira/browse/CARBONDATA-2644>] - Validation
   not present for carbon.load.sortMemory.spill.percentage parameter
   - [CARBONDATA-2646
   <https://issues.apache.org/jira/browse/CARBONDATA-2646>] - While loading
   data into into a table with 'SORT_COLUMN_BOUNDS' property, 'ERROR' flag is
   displayed instead of 'WARN' flag.
   - [CARBONDATA-2658
   <https://issues.apache.org/jira/browse/CARBONDATA-2658>] - Fix bug in
   spilling in-memory pages
   - [CARBONDATA-2666
   <https://issues.apache.org/jira/browse/CARBONDATA-2666>] - Rename
   command should not rename the table directory
   - [CARBONDATA-2669
   <https://issues.apache.org/jira/browse/CARBONDATA-2669>] - Local
   Dictionary Store Size optimisation and other function issues
   - [CARBONDATA-2674
   <https://issues.apache.org/jira/browse/CARBONDATA-2674>] - Streaming
   with merge index enabled does not consider the merge index file while
   pruning.
   - [CARBONDATA-2684
   <https://issues.apache.org/jira/browse/CARBONDATA-2684>] - Code
   Generator Error is thrown when Select filter contains more than one count
   of distinct of ComplexColumn with group by Clause
   - [CARBONDATA-2703
   <https://issues.apache.org/jira/browse/CARBONDATA-2703>] - Fix bugs in
   tests
   - [CARBONDATA-2704
   <https://issues.apache.org/jira/browse/CARBONDATA-2704>] - Index file
   size in describe formatted command is not updated correctly with the
   segment file
   - [CARBONDATA-2715
   <https://issues.apache.org/jira/browse/CARBONDATA-2715>] - Failed to run
   tests for Search Mode With Lucene in Windows env
   - [CARBONDATA-2717
   <https://issues.apache.org/jira/browse/CARBONDATA-2717>] - Table id is
   empty when taking drop lock which causes failure
   - [CARBONDATA-2721
   <https://issues.apache.org/jira/browse/CARBONDATA-2721>] - [SDK]
   [JsonWriter] NPE when schema and data are not of same length or Data is
   null.
   - [CARBONDATA-2722
   <https://issues.apache.org/jira/browse/CARBONDATA-2722>] - [SDK]
   [JsonWriter] Json writer is writing only first element of an array and
   discarding the rest of the elements
   - [CARBONDATA-2724
   <https://issues.apache.org/jira/browse/CARBONDATA-2724>] - Unsupported
   create datamap on table with V1 or V2 format data
   - [CARBONDATA-2729
   <https://issues.apache.org/jira/browse/CARBONDATA-2729>] - Schema
   Compatibility problem between version 1.3.0 and 1.4.0
   - [CARBONDATA-2735
   <https://issues.apache.org/jira/browse/CARBONDATA-2735>] - Performance
   issue for complex array data type when number of elements in array is more
   - [CARBONDATA-2738
   <https://issues.apache.org/jira/browse/CARBONDATA-2738>] - Block
   Preaggregate, Dictionary Exclude/Include for child columns for Complex
   datatype
   - [CARBONDATA-2740
   <https://issues.apache.org/jira/browse/CARBONDATA-2740>] - flat folder
   structure is not handled for implicit column and segment file is not
   getting deleted after load is failed
   - [CARBONDATA-2741
   <https://issues.apache.org/jira/browse/CARBONDATA-2741>] - Exception
   occurs after alter add few columns and selecting in random order
   - [CARBONDATA-2742
   <https://issues.apache.org/jira/browse/CARBONDATA-2742>] - [MV] Wrong
   data displayed after MV creation.
   - [CARBONDATA-2747
   <https://issues.apache.org/jira/browse/CARBONDATA-2747>] - Fix Lucene
   datamap choosing and DataMapDistributable building
   - [CARBONDATA-2749
   <https://issues.apache.org/jira/browse/CARBONDATA-2749>] - In HDFS Empty
   tablestatus file is written during datalaod, iud or compaction when disk is
   full.
   - [CARBONDATA-2751
   <https://issues.apache.org/jira/browse/CARBONDATA-2751>] - Thread leak
   issue in data loading and Compatibility issue
   - [CARBONDATA-2753
   <https://issues.apache.org/jira/browse/CARBONDATA-2753>] - Fix
   Compatibility issues
   - [CARBONDATA-2762
   <https://issues.apache.org/jira/browse/CARBONDATA-2762>] - Long string
   column displayed as string in describe formatted
   - [CARBONDATA-2763
   <https://issues.apache.org/jira/browse/CARBONDATA-2763>] - Create table
   with partition and no_inverted_index on long_string column is not blocked
   - [CARBONDATA-2769
   <https://issues.apache.org/jira/browse/CARBONDATA-2769>] - Fix bug when
   getting shard name from data before version 1.4
   - [CARBONDATA-2777
   <https://issues.apache.org/jira/browse/CARBONDATA-2777>] -
   NonTransactional tables, Select count(*) is not giving latest results for
   incremental load with same segment ID (UUID)
   - [CARBONDATA-2778
   <https://issues.apache.org/jira/browse/CARBONDATA-2778>] - Empty result
   in query after IUD delete operation
   - [CARBONDATA-2779
   <https://issues.apache.org/jira/browse/CARBONDATA-2779>] - Filter query
   is failing for store created with V1/V2 format
   - [CARBONDATA-2781
   <https://issues.apache.org/jira/browse/CARBONDATA-2781>] - Add fix for
   Null Pointer Exception when Pre-aggregate create command is killed from UI
   - [CARBONDATA-2784
   <https://issues.apache.org/jira/browse/CARBONDATA-2784>] - [SDK writer]
   Forever blocking wait with more than 20 batch of data, when consumer is
   dead due to data loading exception
   - [CARBONDATA-2792
   <https://issues.apache.org/jira/browse/CARBONDATA-2792>] - Create
   external table fails post schema restructure
   - [CARBONDATA-2795
   <https://issues.apache.org/jira/browse/CARBONDATA-2795>] - Add
   documentation on the usage of S3 as carbon store
   - [CARBONDATA-2798
   <https://issues.apache.org/jira/browse/CARBONDATA-2798>] - Fix
   Dictionary_Include for ComplexDataType
   - [CARBONDATA-2799
   <https://issues.apache.org/jira/browse/CARBONDATA-2799>] - Query failed
   with bloom datamap on preagg table with dictionary column
   - [CARBONDATA-2802
   <https://issues.apache.org/jira/browse/CARBONDATA-2802>] - Creation of
   Bloomfilter Datamap is failing after UID,compaction,pre-aggregate datamap
   creation
   - [CARBONDATA-2803
   <https://issues.apache.org/jira/browse/CARBONDATA-2803>] - data size is
   wrong in table status & handle local dictionary for older tables is not
   proper, null pointer exption is thrown
   - [CARBONDATA-2804
   <https://issues.apache.org/jira/browse/CARBONDATA-2804>] - Incorrect
   error message when bloom filter or preaggregate datamap tried to be created
   on older V1-V2 version stores
   - [CARBONDATA-2805
   <https://issues.apache.org/jira/browse/CARBONDATA-2805>] - Wrong order
   in custom compaction
   - [CARBONDATA-2808
   <https://issues.apache.org/jira/browse/CARBONDATA-2808>] - Insert into
   select is crashing as both are sharing the same task context
   - [CARBONDATA-2812
   <https://issues.apache.org/jira/browse/CARBONDATA-2812>] - Implement
   freeMemory for complex pages
   - [CARBONDATA-2813
   <https://issues.apache.org/jira/browse/CARBONDATA-2813>] - Major
   compaction on partition table created in 1.3.x store is throwing Unable to
   get file status error.
   - [CARBONDATA-2823
   <https://issues.apache.org/jira/browse/CARBONDATA-2823>] - Alter table
   set local dictionary include after bloom creation fails throwing incorrect
   error
   - [CARBONDATA-2829
   <https://issues.apache.org/jira/browse/CARBONDATA-2829>] - Fix creating
   merge index on older V1 V2 store
   - [CARBONDATA-2831
   <https://issues.apache.org/jira/browse/CARBONDATA-2831>] - Support Merge
   index files read from non transactional table.
   - [CARBONDATA-2832
   <https://issues.apache.org/jira/browse/CARBONDATA-2832>] - Block loading
   error for select query executed after merge index command executed on V1/V2
   store table
   - [CARBONDATA-2834
   <https://issues.apache.org/jira/browse/CARBONDATA-2834>] - Refactor code
   to remove nested for loop to extract invalidTimestampRange.


--
Thanks & Regards,
Ravindra