[DISCUSSION]: Changes to SHOW METACACHE command

[vikramahuja1001]

Current result of Show Metacache command:
<http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png>

Proposed result of Show metacache command for the Driver and the Index
Server:
<http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png>



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[kunalkapoor]

Hi Vikram,
What is the background for these changes and what are the benefits this
will add to carbondata?
Better to add a detailed design document in this thread.

Thanks
Kunal Kapoor

On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <[hidden email]>
wrote:

> Current result of Show Metacache command:
> <
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png>
>
>
> Proposed result of Show metacache command for the Driver and the Index
> Server:
> <
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png>
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>

[vikramahuja1001]

Hi All,

Please find the attached design document for the same.

Thanks

Vikram Ahuja

On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <[hidden email]> wrote:

Hi Vikram,
What is the background for these changes and what are the benefits this
will add to carbondata?
Better to add a detailed design document in this thread.

Thanks
Kunal Kapoor

On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <[hidden email]>
wrote:

> Current result of Show Metacache command:
> <
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png>
>
>
> Proposed result of Show metacache command for the Driver and the Index
> Server:
> <
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png>
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>

[vikramahuja1001]

Hi All,
Please find the attached design document for the same.

https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing

On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <[hidden email]>
wrote:

> Hi Vikram,
> What is the background for these changes and what are the benefits this
> will add to carbondata?
> Better to add a detailed design document in this thread.
>
> Thanks
> Kunal Kapoor
>
> On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <[hidden email]
> >
> wrote:
>
> > Current result of Show Metacache command:
> > <
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> >
> >
> >
> > Proposed result of Show metacache command for the Driver and the Index
> > Server:
> > <
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> >
> >
> >
> >
> >
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> >
>

[manishgupta88]

Hi Vikram

Is the behavior for Show Metacache generic irrespective of database user is
into? i.e every time user executes this command all database details are
displayed OR only specific to DB user is currently logged in.
If it displays for all databases by default, then as a suggestion there
should be some segregation (can be an option in DDL command) and default
behavior should display details only for the logged in database.

Regards
Manish Gupta

On Tue, Dec 17, 2019 at 5:25 PM Vikram Ahuja <[hidden email]>
wrote:

> Hi All,
> Please find the attached design document for the same.
>
>
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
>
> On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <[hidden email]>
> wrote:
>
> > Hi Vikram,
> > What is the background for these changes and what are the benefits this
> > will add to carbondata?
> > Better to add a detailed design document in this thread.
> >
> > Thanks
> > Kunal Kapoor
> >
> > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <
> [hidden email]
> > >
> > wrote:
> >
> > > Current result of Show Metacache command:
> > > <
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > >
> > >
> > >
> > > Proposed result of Show metacache command for the Driver and the Index
> > > Server:
> > > <
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from:
> > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > >
> >
>

[vikramahuja1001]

Hi Manish,
The default behaviour currently is to only show the details of the database
in which the user is currently logged into. That behavior will remain
unchanged.
Regards
Vikram Ahuja

On Wed, Dec 18, 2019 at 7:25 PM manish gupta <[hidden email]>
wrote:

> Hi Vikram
>
> Is the behavior for Show Metacache generic irrespective of database user is
> into? i.e every time user executes this command all database details are
> displayed OR only specific to DB user is currently logged in.
> If it displays for all databases by default, then as a suggestion there
> should be some segregation (can be an option in DDL command) and default
> behavior should display details only for the logged in database.
>
> Regards
> Manish Gupta
>
> On Tue, Dec 17, 2019 at 5:25 PM Vikram Ahuja <[hidden email]>
> wrote:
>
> > Hi All,
> > Please find the attached design document for the same.
> >
> >
> >
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
> >
> > On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <[hidden email]>
> > wrote:
> >
> > > Hi Vikram,
> > > What is the background for these changes and what are the benefits this
> > > will add to carbondata?
> > > Better to add a detailed design document in this thread.
> > >
> > > Thanks
> > > Kunal Kapoor
> > >
> > > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <
> > [hidden email]
> > > >
> > > wrote:
> > >
> > > > Current result of Show Metacache command:
> > > > <
> > > >
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > > >
> > > >
> > > >
> > > > Proposed result of Show metacache command for the Driver and the
> Index
> > > > Server:
> > > > <
> > > >
> > >
> >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sent from:
> > > >
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > > >
> > >
> >
>

hi,

+1,
Looks good.
Can you please update the document with more clear explanation.

Regards,
Akash

On 2019/12/17 11:55:30, Vikram Ahuja <[hidden email]> wrote:

> Hi All,
> Please find the attached design document for the same.
>
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
>
> On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <[hidden email]>
> wrote:
>
> > Hi Vikram,
> > What is the background for these changes and what are the benefits this
> > will add to carbondata?
> > Better to add a detailed design document in this thread.
> >
> > Thanks
> > Kunal Kapoor
> >
> > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <[hidden email]
> > >
> > wrote:
> >
> > > Current result of Show Metacache command:
> > > <
> > >
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > >
> > >
> > >
> > > Proposed result of Show metacache command for the Driver and the Index
> > > Server:
> > > <
> > >
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from:
> > > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > >
> >
>

[kunalkapoor]

Hi Vikram,
I think the proposed change will bring more clarity to the show cache
output.

I have a suggestion, let us have a command which can show the cache
occupied by each of the executors(only applicable for index server).
Something like *show executor metacache*, where the "executor" keyword is
optional.
This command will not show per table, only per node

Example:
Driver - X bytes
Executor1 - Y bytes
Executor2 - Z bytes

Thanks
Kunal Kapoor

On Fri, Jan 3, 2020 at 11:11 AM Akash Nilugal <[hidden email]>
wrote:

> hi,
>
> +1,
> Looks good.
> Can you please update the document with more clear explanation.
>
> Regards,
> Akash
>
> On 2019/12/17 11:55:30, Vikram Ahuja <[hidden email]> wrote:
> > Hi All,
> > Please find the attached design document for the same.
> >
> >
> https://docs.google.com/document/d/1qbr8-Ci_tCvh1tuEdxo3xJkLhDksdnfKuZiDtQCUujk/edit?usp=sharing
> >
> > On Tue, Nov 26, 2019 at 10:28 PM Kunal Kapoor <[hidden email]>
> > wrote:
> >
> > > Hi Vikram,
> > > What is the background for these changes and what are the benefits this
> > > will add to carbondata?
> > > Better to add a detailed design document in this thread.
> > >
> > > Thanks
> > > Kunal Kapoor
> > >
> > > On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 <
> [hidden email]
> > > >
> > > wrote:
> > >
> > > > Current result of Show Metacache command:
> > > > <
> > > >
> > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/currentSM.png
> > > >
> > > >
> > > >
> > > > Proposed result of Show metacache command for the Driver and the
> Index
> > > > Server:
> > > > <
> > > >
> > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t423/proposedSM.png
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sent from:
> > > >
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> > > >
> > >
> >
>