Uploading files in REST API fails in CS 20.4, build 16.2.14.1329

Hi
After patching from 20.3 to 20.4 uploading files in our project fails.
We get an error: "ERROR WebDocUtils.GetFileUploadInfo: An illegal attempt was made to upload a document - An unknown feature was specified"
We tried uploading with Postman and that works fine but our C# project fails.
Our code:

HttpClient client = new HttpClient();

client.BaseAddress = new Uri(rootUrl);

client.DefaultRequestHeaders.Add("otcsticket", _authInfo.Ticket);

var filename = $"Test Document {DateTime.Now.ToString("HH.mm.ss")}.pdf";

var formData = new MultipartFormDataContent();

formData.Headers.ContentType.MediaType = "multipart/form-data";

formData.Add(new StringContent("144"), "type");

formData.Add(new StringContent("813217"), "parent_id");

formData.Add(new StringContent(filename), "name");

formData.Add(new ByteArrayContent(System.IO.File.ReadAllBytes(@C:\Test Document.pdf)), "file", filename);

var response = client.PostAsync($"v2/nodes", formData).Result;

Find more posts tagged with

Comments

Appu Nair

Somethings you might check

Is an Upload Directory defined if so the C:\TEST is that a client path or a server path play with a file in the severs path...
Put logs wit at least Connect Logs and Thread logs
You say it works with Postman do you see decipherable changes from its code vs yours
Can you put network tools and see if you can capture how SmartUI does it?

I ran a similar code right now in api/v1/nodes not even going to v2 and it worked...
I can share the postman Jquery stuff if it helps to see what it looks like

Peter Forsbom

Did you try v2?
There are some differences in the log files.
This is from uploading with Postman - working fine:

11/04/2020 13:22:01 INFO [1082471930285] Processing Request on socket 0000016F13E99EE0

11/04/2020 13:22:01 INFO KIntl::Initialize - default Locale Suffix: _en_US

11/04/2020 13:22:01 INFO KIntl::SysInitialize - MultiByte set to TRUE

11/04/2020 13:22:01 INFO KIntl::SysInitialize - Encoding set to 1

11/04/2020 13:22:01 INFO KIntl::SysInitialize - IntlStrings set to TRUE

11/04/2020 13:22:01 INFO KIntl::Initialize - added key to environment: NLS_LANG=.AL32UTF8

11/04/2020 13:22:01 INFO

11/04/2020 13:22:01 INFO Wed Nov 04 13:22:01 2020

11/04/2020 13:22:01 INFO _REQUEST = 'llweb'

11/04/2020 13:22:01 INFO AUTH_TYPE = ''

11/04/2020 13:22:01 INFO body = '{"roles":{"categories":{"19923_3":"Application for Permit"}}}'

11/04/2020 13:22:01 INFO CONTENT_LENGTH = '65692'

11/04/2020 13:22:01 INFO CONTENT_TYPE = 'multipart/form-data; boundary=---------A1EA321D-1CEC-4244-A873-694133C2241F'

11/04/2020 13:22:01 INFO file = 'D:\CS\upload\otup81383a18-ddf2-4e81-8769-ac60435abfb3_6_1604492521'

11/04/2020 13:22:01 INFO file_content_type = 'application/octet-stream'

11/04/2020 13:22:01 INFO file_filelength = '64927'

11/04/2020 13:22:01 INFO file_filename = 'Test Document.pdf'

11/04/2020 13:22:01 INFO GATEWAY_INTERFACE = 'CGI/1.1'

11/04/2020 13:22:01 INFO HTTP_ACCEPT = 'application/json, text/json, text/x-json, text/javascript, application/xml, text/xml'

11/04/2020 13:22:01 INFO HTTP_ACCEPT_ENCODING = 'gzip, deflate'

11/04/2020 13:22:01 INFO HTTP_CONTENT_LENGTH = '65692'

11/04/2020 13:22:01 INFO HTTP_CONTENT_TYPE = 'multipart/form-data; boundary=---------A1EA321D-1CEC-4244-A873-694133C2241F'

11/04/2020 13:22:01 INFO HTTP_HOST = 'content-test.wellesley.no'

11/04/2020 13:22:01 INFO HTTP_OTCSTICKET = ''

11/04/2020 13:22:01 INFO HTTP_USER_AGENT = 'RestSharp/106.11.7.0'

11/04/2020 13:22:01 INFO HTTPS = 'off'

11/04/2020 13:22:01 INFO LLSYSPARAMS_ASSOC = 'A<1,?,''_uploadFilenames''={''D:\\CS\\upload\\otup81383a18-ddf2-4e81-8769-ac60435abfb3_6_1604492521''},''_uploadPath''=''D:\\CS\\upload\\''>'

11/04/2020 13:22:01 INFO name = 'Test Document.pdf'

11/04/2020 13:22:01 INFO parent_id = '813217'

11/04/2020 13:22:01 INFO PATH_INFO = '/api/v2/nodes'

11/04/2020 13:22:01 INFO PATH_TRANSLATED = 'C:\inetpub\wwwroot\api\v2\nodes'

11/04/2020 13:22:01 INFO QUERY_STRING = ''

11/04/2020 13:22:01 INFO REMOTE_ADDR = '10.253.58.100'

11/04/2020 13:22:01 INFO REMOTE_HOST = '10.253.58.100'

11/04/2020 13:22:01 INFO REMOTE_USER = ''

11/04/2020 13:22:01 INFO REQUEST_ID = '493db3cc-72e7-48df-9ce0-bf0899e7d576'

11/04/2020 13:22:01 INFO REQUEST_METHOD = 'POST'

11/04/2020 13:22:01 INFO REQUEST_PROCESSING_DURATION = '0'

11/04/2020 13:22:01 INFO SCRIPT_NAME = '/otcs/llisapi.dll'

11/04/2020 13:22:01 INFO SERVER_NAME = 'content-test.wellesley.no'

11/04/2020 13:22:01 INFO SERVER_PORT = '80'

11/04/2020 13:22:01 INFO SERVER_PROTOCOL = 'HTTP/1.1'

11/04/2020 13:22:01 INFO SERVER_SOFTWARE = 'Microsoft-IIS/10.0'

11/04/2020 13:22:01 INFO type = '144'

11/04/2020 13:22:01 WARN X-Forwarded-For validation enabled but no header present in request

11/04/2020 13:22:01 INFO needs validation:

\CS\prog\temp\webdoc\

11/04/2020 13:22:01 INFO WebDocUtils.GetFileUploadInfo: Using file:

\CS\upload\otup81383a18-ddf2-4e81-8769-ac60435abfb3_6_1604492521

This is from the code we use - giving error. NOTE: the entire content of the file we uploaded was in the log. I replaced it with FILE_CONTENT_HERE

11/04/2020 13:44:08 INFO [1083798693419] Processing Request on socket 0000016F143264A0

11/04/2020 13:44:08 INFO KIntl::Initialize - default Locale Suffix: _en_US

11/04/2020 13:44:08 INFO KIntl::SysInitialize - MultiByte set to TRUE

11/04/2020 13:44:08 INFO KIntl::SysInitialize - Encoding set to 1

11/04/2020 13:44:08 INFO KIntl::SysInitialize - IntlStrings set to TRUE

11/04/2020 13:44:08 INFO KIntl::Initialize - added key to environment: NLS_LANG=.AL32UTF8

11/04/2020 13:44:08 INFO

11/04/2020 13:44:08 INFO Wed Nov 04 13:44:08 2020

11/04/2020 13:44:08 INFO _REQUEST = 'llweb'

11/04/2020 13:44:08 INFO AUTH_TYPE = ''

11/04/2020 13:44:08 INFO CONTENT_LENGTH = '65568'

11/04/2020 13:44:08 INFO CONTENT_TYPE = 'multipart/form-data; boundary="8f683f8f-2883-4400-a30f-77ff567911fa"'

11/04/2020 13:44:08 INFO file; filename="Test Document .pdf" = 'FILE_CONTENT_HERE'

11/04/2020 13:44:08 INFO GATEWAY_INTERFACE = 'CGI/1.1'

11/04/2020 13:44:08 INFO HTTP_ACCEPT = 'multipart/form-data'

11/04/2020 13:44:08 INFO HTTP_CONTENT_LENGTH = '65568'

11/04/2020 13:44:08 INFO HTTP_CONTENT_TYPE = 'multipart/form-data; boundary="8f683f8f-2883-4400-a30f-77ff567911fa"'

11/04/2020 13:44:08 INFO HTTP_EXPECT = '100-continue'

11/04/2020 13:44:08 INFO HTTP_HOST = 'xxxxx'

11/04/2020 13:44:08 INFO HTTP_OTCSTICKET = ''

11/04/2020 13:44:08 INFO HTTPS = 'off'

11/04/2020 13:44:08 INFO LLSYSPARAMS_ASSOC = 'A<1,?,''_uploadFilenames''={},''_uploadPath''=''D:\\CS\\upload\\''>'

11/04/2020 13:44:08 INFO name = 'Test Document.pdf'

11/04/2020 13:44:08 INFO parent_id = '813217'

11/04/2020 13:44:08 INFO PATH_INFO = '/api/v2/nodes'

11/04/2020 13:44:08 INFO PATH_TRANSLATED = 'C:\inetpub\wwwroot\api\v2\nodes'

11/04/2020 13:44:08 INFO QUERY_STRING = ''

11/04/2020 13:44:08 INFO REMOTE_ADDR = 'xxxxxx'

11/04/2020 13:44:08 INFO REMOTE_HOST = 'xxxx'

11/04/2020 13:44:08 INFO REMOTE_USER = ''

11/04/2020 13:44:08 INFO REQUEST_ID = '04b3424d-f358-40bd-9e74-1734968bc397'

11/04/2020 13:44:08 INFO REQUEST_METHOD = 'POST'

11/04/2020 13:44:08 INFO REQUEST_PROCESSING_DURATION = '0'

11/04/2020 13:44:08 INFO SCRIPT_NAME = '/otcs/llisapi.dll'

11/04/2020 13:44:08 INFO SERVER_NAME = 'xxxxx'

11/04/2020 13:44:08 INFO SERVER_PORT = '80'

11/04/2020 13:44:08 INFO SERVER_PROTOCOL = 'HTTP/1.1'

11/04/2020 13:44:08 INFO SERVER_SOFTWARE = 'Microsoft-IIS/10.0'

11/04/2020 13:44:08 INFO type = '144'

11/04/2020 13:44:08 WARN X-Forwarded-For validation enabled but no header present in request

11/04/2020 13:44:08 INFO needs validation:

\CS\prog\temp\webdoc\

11/04/2020 13:44:08 ERROR WebDocUtils.GetFileUploadInfo: An illegal attempt was made to upload a document - An unknown feature was specified

11/04/2020 13:44:08 INFO Dispatcher error: An illegal attempt was made to upload a document

11/04/2020 13:44:08 INFO Wed Nov 04 13:44:08 2020 - 79934945 Func='REST-POST-[V2].nodes.[813217]' Timing: 0.024 0.024 0.024

Matthew_Pinkney

Take a look at this post . They were doing something similar and got it to work.

Ferdinand Prantl

You did not surround the request content part name with quotation marks. (You did it for the filename only.) This is a part of the request body serialised by your code:

Content-Disposition: form-data; name=file; filename="Test Document.pdf"

.NET Core does not insert quotation marks, because the value can be intentionally formatted with or without them by the client code. Other servers may accept requests without quotation marks, but CS REST API is sensitive to them. I do not know, if it is a bug or not. You could file an enquiry about it with the OT CS. If you add the quotation marks, the request body will contain a part like this and the request will succeed:

Content-Disposition: form-data; name="file"; filename="Test Document.pdf"

Otherwise your code looks well. You might consider attaching it as a text file next time. Support for text formatting and code examples in this forum is horrible. Your example is still legible, but it is pushing the patience of people, who try to help you.

I attached a C# program uploading a file and the network communication from its run.

upload.cs.txt

network.log.txt

Peter Forsbom

Hi
I found the culprit! It turns out that the filename you provide when adding the file can not contain space or special language specific characters such as æøå.

My code:
This is the actual name of the document and can still contain space or special chars

formData.Add(new StringContent(filename), "name");

The filename parameter is what need your attention: remove spaces and special chars and you are good to go!

formData.Add(new ByteArrayContent(System.IO.File.ReadAllBytes(@C:\Test Document.pdf)), "file", filename);

regards
Peter

Peter Forsbom

I am going to "re-open" this post. Although I was able to get the above code to work by removing spaces and special characters, this is not something I can live with.

I found a fix for spaces in the filename by adding double quotation in file and filename like this:

formData.Add(new ByteArrayContent(File.ReadAllBytes(@"Document with space.pdf")), "\"file\"", "\"Document with space.pdf\"");

But I still can not figure out how to add a file with special characters such as '§' or norwegian æ,ø,å. Again: this used to work in v. 20.3.

Can someone get the following C# code to work on REST API v.20.4.x?

var client = new HttpClient();

client.BaseAddress = new Uri(rootUrl);

client.DefaultRequestHeaders.Add("otcsticket", "my otcs ticket");

var formData = new MultipartFormDataContent();

formData.Headers.ContentType.MediaType = "multipart/form-data";

formData.Add(new StringContent("144"), "type");

formData.Add(new StringContent("23407"), "parent_id");

formData.Add(new StringContent("Document with space and special char.PDF"), "name");

formData.Add(new ByteArrayContent(File.ReadAllBytes(@"D:\Document with space and special char.PDF")), "\"file\"", "\"Document with space and special char - §.pdf\"");

As you can see the filename has the following special character: §. The file is added but not recognized as a PDF and the version filename is scrambled and looks something like this: =?utf-8?B?TmV0ZmxpeCBqZWtrZXIgb3BwIHByaXNlbiBmb3Igbm9yc2tlIGJydWtlcmUgw6UucGRm?=

If I remove the lading =?utf-8?B? and trailing ?= then the remainder is the filename encoded with base64.

@Ferdinand Prantl your code worked with spaces but not with special characters.

Peter Forsbom

It seems that the .NET HttpClient is base64 encoding the filename if it contains special characters. Starting from v. 20.4 the REST API no longer accepts that for some reason.

I tried going old school using HttpWebRequest and that solved the problem!