Performance Issues with Large File Uploads on Content Server cloud edition.

Nitesh harjai · 2025-03-11T15:44:00+00:00

There was an error rendering this rich post.

Hi Developers,

I am currently facing an issue where a customer is uploading large files (20GB+) to the content server folder. The uploads are extremely slow, taking over 50 minutes to complete, and in some cases, the requests even time out.

While I can adjust the timeout settings to prevent these requests from expiring, I would like to understand the potential implications of setting the timeout to never expire.

Additionally, I am seeking advice on how to fine-tune the system for better performance. Specifically, I would like to know if there are any performance parameters related to the database (PostgreSQL) or other system settings that I can optimize to improve the upload speed.

Thanks,
Nitesh

Find more posts tagged with

Note:

If there are Accepted Answers, those will be shown by default. You can switch to 'All Replies' by selecting the tab below.

Accepted answers

All comments

appuq

What is the CGI part of your upload? What I mean is the script that is called livelink.exe/cs.exe that kind. If it is IIS, then it has a certain finite timeout which cannot be extended, so if you go to the event viewer, you will sometimes see"the script that started from blah blah hasn't responded and hence IIS is terminating that kind".In many cases like that, customers will deploy a front end on Tomcat as it has more capabilities in that realm. Or if you use ObjectImporter, in which case the file is being accessed directly by an oscript process. Having said all of this, I am wondering if they expect to click a link and get the 20GB files back. They seem to be extremely large for content server use cases.

CS Performance analysis has a lot of work, and it is rather difficult to say what makes sense in a public forum. The best you can do is to take training in performance analysis(performance analyzer), which used to be an architectural course that I attended circa 2006 or so. In any case, once the node allocation has happened, which is a DB transaction, getting the file to EFS or OTAS is not going to be counted against the DB.

Nitesh harjai

Hi @appuq,

The script being executed is cs/cs, and our system is running on a Linux machine with the frontend deployed on a Tomcat server. Based on my analysis, we can fine-tune the system only after reviewing the Transaction (connect) logs to identify potential bottlenecks.

Since the application is deployed on Tomcat, What settings do we need to enable for uploading large files without timeouts?

Thanks

appuq

Most likely, your environment is a POD(K8S)-based one. You might have to check with the cloud provider to see what the bottleneck is. If I were you, I would create a "benchmark" by creating a livelink on unix an tomcat using a VM and looking at how long your 20 GB file takes. Alternatively, look into the white papers that OT produces that capture the benchmarks. Are your users using the SMARTUI GUI or Classic GUI to upload, or are the processes REST API driven? if it is RESTAPI, look at the recent improvements OT did to large file uploads. If it is SOA,P as I mentioned earlier TC SOAP services are the better avenues.

appuq

You should start a ticket. I see a new section. However, it doesn't say whether it pertains to programmatic or GUI uploads. In our TC served CS, it didn't work, or I don't fully know what this means so it looks like 4GB might be what OT expects, which seems to be a IIS kind of setting.So the fact that 20GB works for you is great.

Nitesh harjai

The ticket has already been submitted, and I am currently awaiting the activation of the necessary setting to proceed. As we are utilizing a user-based upload via a smart UI, rather than an API upload, the process will be tested once the option is enabled. Based on my research and development, I observed that uploading a 20GB file to the CS via the GUI took approximately 57 minutes. I will conduct further testing once the setting is configured and will provide results here.