[jira] [Commented] (CARBONDATA-3325) The parameter CarbonCommonConstants.CARBON_TIMESTAMP_FORMAT and CarbonCommonConstants.CARBON_DATE_FORMAT don't have effect in streaming table writing

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-3325) The parameter CarbonCommonConstants.CARBON_TIMESTAMP_FORMAT and CarbonCommonConstants.CARBON_DATE_FORMAT don't have effect in streaming table writing

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16799550#comment-16799550 ]

[hidden email] commented on CARBONDATA-3325:
--------------------------------------------------

This way:

CarbonSparkStreamingFactory

.getStreamSparkStreamingWriter(carbonSession, db, table)

.option("timestampformat","yyyy-MM-dd HH:mm:ss")
 .mode(SaveMode.Append)
 .writeStreamData(dataFrame, time)

 

is ok;

 

because of this code in CarbonLoadModelBuilder:

String timestampformat = optionsFinal.get("timestampformat");

carbonLoadModel.setTimestampformat(timestampformat);

 

 

but the CarbonProperties absolutely don't have effect.

 

 

> The parameter CarbonCommonConstants.CARBON_TIMESTAMP_FORMAT and CarbonCommonConstants.CARBON_DATE_FORMAT don't have effect in streaming table writing
> -----------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3325
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3325
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>    Affects Versions: 1.5.2
>            Reporter: [hidden email]
>            Priority: Major
>             Fix For: 1.5.2
>
>   Original Estimate: 96h
>  Remaining Estimate: 96h
>
> When I write data into streaming table. 
> I use such code:
> CarbonProperties.getInstance()
>  .addProperty(CarbonCommonConstants.CARBON_TIMESTAMP_FORMAT, "yyyy/MM/dd HH:mm:ss")
>  .addProperty(CarbonCommonConstants.CARBON_DATE_FORMAT, "yyyy/MM/dd")
>  
> but don't have effect



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)