carbondata with presto unsupported Complex Types

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

carbondata with presto unsupported Complex Types

dylan
hello all:
    i find presto  unsupported Complex Types when using carbondata,
    on hive table,desc table like this :
       Column       |                                    Type                                    
|     Extra     | Comment
-------------------+-----------------------------------------------------------------------------+---------------+---------
 a           | varchar                                                                    
|               |        
 b            | varchar                                                                    
|               |        
 c            | integer                                                                    
|               |        
 d             | row(lat varchar, lon varchar)                                              
|               |        

    on carbondata table ,desc table like this :
       Column       |                                    Type                                    
|     Extra     | Comment
-------------------+-----------------------------------------------------------------------------+---------------+---------
 a           | varchar                                                                    
|               |        
 b            | varchar                                                                    
|               |        
 c            | integer                                                                    
|               |        
 d             | varchar                                              |              
|        
 
  the struct type field 'd' does not recognize, can not participate in query
calculation,

  this carbondata table use spark to desc is ok.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: carbondata with presto unsupported Complex Types

anubhavtarar
Hi dylan,
Currently Carbondata-Presto connector does not support reading complex data
type from carbondata,we are looking into this issue,thats why it is showing
as varchar for complexdatatype when you describe the table

On Thu, Dec 7, 2017 at 3:52 PM, dylan <[hidden email]> wrote:

> hello all:
>     i find presto  unsupported Complex Types when using carbondata,
>     on hive table,desc table like this :
>        Column       |                                    Type
> |     Extra     | Comment
> -------------------+----------------------------------------
> -------------------------------------+---------------+---------
>  a           | varchar
> |               |
>  b            | varchar
> |               |
>  c            | integer
> |               |
>  d             | row(lat varchar, lon varchar)
> |               |
>
>     on carbondata table ,desc table like this :
>        Column       |                                    Type
> |     Extra     | Comment
> -------------------+----------------------------------------
> -------------------------------------+---------------+---------
>  a           | varchar
> |               |
>  b            | varchar
> |               |
>  c            | integer
> |               |
>  d             | varchar                                              |
> |
>
>   the struct type field 'd' does not recognize, can not participate in
> query
> calculation,
>
>   this carbondata table use spark to desc is ok.
>
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.
> n5.nabble.com/
>



--
Thanks and Regards

*   Anubhav Tarar     *


* Software Consultant*
      *Knoldus Software LLP <http://www.knoldus.com/home.knol>       *
       LinkedIn <http://in.linkedin.com/in/rahulforallp>     Twitter
<https://twitter.com/RahulKu71223673>    fb <[hidden email]>
          mob : 8588915184
Reply | Threaded
Open this post in threaded view
|

Re: carbondata with presto unsupported Complex Types

dylan
hi  anubhavtarar:
    thanks for you reply
     Do you have plans to support complex types, although not commonly used,
but sometimes it is necessary.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: carbondata with presto unsupported Complex Types

bhavya411
Hi Dylan,

Yes we have plans to support the complex type in Presto Integration in near
future, will update you once it is done.

Regards
Bhavya

On Mon, Dec 11, 2017 at 1:36 PM, dylan <[hidden email]> wrote:

> hi  anubhavtarar:
>     thanks for you reply
>      Do you have plans to support complex types, although not commonly
> used,
> but sometimes it is necessary.
>
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.
> n5.nabble.com/
>