can CarbonThriftServer configure the max number of submit task at the same time?

[喜之郎]

hi dev,
I start CarbonThriftServer, then use beeline to connect it. But when I submit 60 sqls at the same time, all task failed.
So I want to know, is there a configure to restrict the max number of running sql in carbonthriftserver, for example, if the number of running sql is larger than this number, you can not submit this sql through beeline?

[xuchuanyin]

Maybe you can try `hive.server2.thrift.max.worker.threads` and set a smaller value for it.

You can configure it in hive-site.xml or pass the configuration through —hiveconf when you start the thrift-server.

At last, you need to find out the root cause of the failed sqls. 60 concurrent queries is not problem in a normal cluster. It may be resource/query related.

> On May 3, 2018, at 15:31, 喜之郎 <[hidden email]> wrote:
>
> hi dev,
> I start CarbonThriftServer, then use beeline to connect it. But when I submit 60 sqls at the same time, all task failed.
> So I want to know, is there a configure to restrict the max number of running sql in carbonthriftserver, for example, if the number of running sql is larger than this number, you can not submit this sql through beeline?

[喜之郎]

yes, this config works. thanks.
My sql is a very big sql， so 60 concurrent queries does not work.






------------------ 原始邮件 ------------------
发件人: "xuchuanyin"<[hidden email]>;
发送时间: 2018年5月3日(星期四) 晚上10:41
收件人: "dev"<[hidden email]>;

主题: Re: can CarbonThriftServer configure the max number of submit task at the same time?



Maybe you can try `hive.server2.thrift.max.worker.threads` and set a smaller value for it.

You can configure it in hive-site.xml or pass the configuration through —hiveconf when you start the thrift-server.

At last, you need to find out the root cause of the failed sqls. 60 concurrent queries is not problem in a normal cluster. It may be resource/query related.

> On May 3, 2018, at 15:31, 喜之郎 <[hidden email]> wrote:
>
> hi dev,
> I start CarbonThriftServer, then use beeline to connect it. But when I submit 60 sqls at the same time, all task failed.
> So I want to know, is there a configure to restrict the max number of running sql in carbonthriftserver, for example, if the number of running sql is larger than this number, you can not submit this sql through beeline?