[jira] [Commented] (CARBONDATA-37) Support Date/Time format for Timestamp columns to be defined at column level

[Akash R Nilugal (Jira)]

    [ https://issues.apache.org/jira/browse/CARBONDATA-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15617340#comment-15617340 ]

ASF GitHub Bot commented on CARBONDATA-37:
------------------------------------------

Github user lion-x commented on a diff in the pull request:

    https://github.com/apache/incubator-carbondata/pull/219#discussion_r85633017
 
    --- Diff: processing/src/main/java/org/apache/carbondata/processing/surrogatekeysgenerator/csvbased/CarbonCSVBasedSeqGenStep.java ---
    @@ -470,6 +472,34 @@ public boolean processRow(StepMetaInterface smi, StepDataInterface sdi) throws K
                   break;
               }
             }
    +        HashMap<String, String> dateformatsHashMap = new HashMap<String, String>();
    +        if (meta.dateFormat != null) {
    +          String[] dateformats = meta.dateFormat.split(CarbonCommonConstants.COMMA);
    +          for (String dateFormat:dateformats) {
    +            String[] dateFormatSplits = dateFormat.split(":", 2);
    +            dateformatsHashMap.put(dateFormatSplits[0].toLowerCase().trim(),
    +                dateFormatSplits[1].trim());
    +          }
    +        }
    +        String[] DimensionColumnIds = meta.getDimensionColumnIds();
    +        directDictionaryGenerators =
    +            new DirectDictionaryGenerator[DimensionColumnIds.length];
    +        for (int i = 0; i < DimensionColumnIds.length; i++) {
    +          ColumnSchemaDetails columnSchemaDetails = columnSchemaDetailsWrapper.get(
    +              DimensionColumnIds[i]);
    +          if (columnSchemaDetails.isDirectDictionary()) {
    +            String columnName = columnSchemaDetails.getColumnName();
    +            DataType columnType = columnSchemaDetails.getColumnType();
    +            if (dateformatsHashMap.containsKey(columnName)) {
    --- End diff --
   
    ok

> Support Date/Time format for Timestamp columns to be defined at column level
> ----------------------------------------------------------------------------
>
>                 Key: CARBONDATA-37
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-37
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Vimal Das Kammath
>            Assignee: Lionx
>
> Carbon support defining the Date/Time format. But the configuration for the same is present in carbon.properties and hence is global for all tables.
> This global configuration for timestamp format cannot support scenarios where different tables or different Timestamp columns in the same table.
> Suggest to provide option in the create table DDL itself to define the format for each Timestamp column. Also provide defaults so that users can create table with Timestamp columns without having to always define the Date/Time format.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)