Using XML Search API in .NET

Hi,I know I can submit a query like this in an actual browser, and the XML that is returned will be displayed in the browser:http://server/folder/livelink.exe?func=search&lookfor1=allwords&where1=report&outputformat=xmlQ. Does anyone know how I would submit this http request through VB.NET or C# in an aspx page, and store the XML results in an XML Document? (I want to do things with the data in the XML Document before displaying it...)Thanks in Advance,BLH

Find more posts tagged with

Comments

Raphael_Thiney_(rthiney_-_(deleted))

Did you ever get answer to this?

Daniel__Morgan_(danielmorgan_-_(deleted))

This is like the holy grail for me. I have searched out ways and still have not found anyone that has been able to do it. But I will share what I have figured out thus far. Even the folks at OpenText are unsure.You can do a HttpWebRequest passing network credentials. Now I have to authenticate with my proxy first. Then I send the webrequest to my livelink server passing network credentials. This works.However, LiveLink does a redirect and returns only a portion of the url instead of the initial URL requested.ie URL = /livelink/livelink.exe?func=ll&objId=12902658&objAction=view&outputrss=trueThis partial URL then gets appended to the base URL of the server name from which it was called. For example: if I run the asp.net app from http://mydomain.com/ then the partial url is automatically appened to to that verse http://mylivelinkdomain.com/.Using mshtml ref in my code - I was able to parse this partial url. However, I need someway to put the complete url to the xml rss document into an XmlReader for parsing with out getting a 401 error.Anyone else have some suggestions because I am at a loss as well.

Pierre_Nocera

Message from Pierre Nocera <pnocera@opentext.com> via eLink

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">Parsing live link XML document from ASP.NET

Did you try to set the HttpWebRequest.AllowAutoRedirect property to false so that you may catch the 302 redirect yourself ?

De: eLink Discussion: Development Discussion [mailto:development@elinkkc.opentext.com]
Date: mer. 04/07/2007 16:40
À: eLink Recipient
Objet : Parsing live link XML document from ASP.NET

Parsing live link XML document from ASP.NET
Posted by Morgan, Daniel on 07/04/2007 10:36 AM

This is like the holy grail for me. I have searched out ways and still have not found anyone that has been able to do it. But I will share what I have figured out thus far. Even the folks at OpenText are unsure.

You can do a HttpWebRequest passing network credentials. Now I have to authenticate with my proxy first. Then I send the webrequest to my livelink server passing network credentials. This works.

However, LiveLink does a redirect and returns only a portion of the url instead of the initial URL requested.

ie URL = /livelink/livelink.exe?func=ll&objId=12902658&objAction=view&outputrss=true

This partial URL then gets appended to the base URL of the server name from which it was called.

For example: if I run the asp.net app from http://mydomain.com/ then the partial url is automatically appened to to that verse http://mylivelinkdomain.com/.

Using mshtml ref in my code - I was able to parse this partial url. However, I need someway to put the complete url to the xml rss document into an XmlReader for parsing with out getting a 401 error.

Anyone else have some suggestions because I am at a loss as well.

[To reply to this thread, use your normal E-mail reply function.]

============================================================

Topic: Using XML Search API in .NET
https://knowledge.opentext.com/knowledge/llisapi.dll/open/3097447

Discussion: Development Discussion
https://knowledge.opentext.com/knowledge/llisapi.dll/open/786303

Livelink Server:
https://knowledge.opentext.com/knowledge/llisapi.dll

To Unsubscribe from this Discussion, send an e-mail to unsubscribe.development@elinkkc.opentext.com.

Daniel__Morgan_(danielmorgan_-_(deleted))

Yes, but then it requires you to click to follow the link to the xml doc.What I would like it to do is to go stright to the XML document so I can parse it. Currently, the way LiveLink works is it first will go to the base url then it will redirect to the requested url via a redirect.html file. So what happens is my code ends up trying to parse the redirect.html. I am stuck.

PMMA

Guys, did anyone find an answer to this issue?Were attempting to integrate a Livelink XML search with ASP. NET and are running into a few issues.From the front end were building a URL and posting it to the Livelink server hoping to get a response as an XML string but instead are receiving a server redirect command. When the URL is posted directly into a browser the results are successfully returned. Please see the code below: Dim webResponse As HttpWebResponse Dim pageRequest As HttpWebRequest Dim reader As IO.StreamReader Dim str As String pageRequest = Net.HttpWebRequest.Create("http://dcms-erm3/livelink/livelink.exe?func=search&outputformat=xml&where1=lottery+fund") pageRequest.Credentials = CredentialCache.DefaultCredentials pageRequest.AllowAutoRedirect = True webResponse = pageRequest.GetResponse reader = New IO.StreamReader(webResponse.GetResponseStream) str = reader.ReadToEnd() txt.Text = strWe are expecting: <?xml version="1.0" encoding="ISO-8859-1" ?>- - - <>2000 62156 62181 76530 76298 76960 77059 </><>2322 111169 111170 111171 111178 </><>2322 111169 111170 111181 111191 111699 111700 </><>2322 111169 112636 112758 112759 113047 113048 </><>2322 111169 113068 113077 </><>2322 111169 114090 114419 114422 </><>2322 111169 114936 114939 </><>2322 111169 114936 115007 115008 115015 </>But are getting: .browseRow1 { background-color: #FFFFFF; } .browseRow2 { background-color: #EEEEEE; }Livelink - RedirectionI'm assuming that the initial URL is parsed and then transferred on the server hence the response were getting. Is the XML searching compatible with ASP. NET? and if so is there any guidance or code snippets available.Any help would be much appreciated.

Pierre_Nocera

Try to set the cookies. Do a first call to get the cookie and a second to get xml results :HttpWebResponse webResponse;HttpWebRequest pageRequest;StreamReader reader;Stream os;String str;CookieCollection cookies = null;pageRequest = (HttpWebRequest)HttpWebRequest.Create("http://****/livelink/livelink.exe?func=search&outputformat=xml&where1=lottery+fund");pageRequest.Credentials = CredentialCache.DefaultCredentials;pageRequest.AllowAutoRedirect = true;pageRequest.CookieContainer = new CookieContainer();webResponse = (HttpWebResponse)pageRequest.GetResponse(); cookies = webResponse.Cookies;pageRequest = (HttpWebRequest)HttpWebRequest.Create("http://***/livelink/livelink.exe?func=search&outputformat=xml&where1=lottery+fund");pageRequest.Credentials = CredentialCache.DefaultCredentials;pageRequest.AllowAutoRedirect = true;pageRequest.CookieContainer = new CookieContainer();pageRequest.CookieContainer.Add(cookies);webResponse = (HttpWebResponse)pageRequest.GetResponse(); os = webResponse.GetResponseStream();reader = new StreamReader(os, System.Text.Encoding.ASCII);textBox1.Text = reader.ReadToEnd();

PMMA

Thanks PierreJust tested out your suggestion and it is exactly what I was looking for.

Daniel__Morgan_(danielmorgan_-_(deleted))

Thanks Pierre!That worked perfect!I don't understand it exactly. It looks like you are making two calls to the server. The first request sets the cookie with the server information ignoring the redirect information and the second request uses the new cookie to request the xml file from the server after the clients cookie has forwarded its information.Is this correct and can you elaborate?Respectfully, Dan

Nair_Krishnankutty_(nairkrishnankutty_-_(deleted))

hopefully this may help.Type javascript:document.cookie in the URL and hit enterwhen you first login to livelink.Once you login repeat theprocess you will see that the cookies now contain lots more info.You will see the presence of a LLCookie which is a session/memory cookie,which helps in bypassing the redirect for login.That I guess is why the screen scaraping part works as intended.The authentication would be seamless if you used a directory services livelink.If this was not the qn I apologize

Pierre_Nocera

Message from Pierre Nocera <pnocera@opentext.com> via eLink

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">Thank You!

Hi Daniel,

When you connect to Livelink with IE or whatever browser for the first time, LL sets a cookie on your browser which contains an authentication token, which is then sent back with further requests you do on the server.

If this cookie is not set LL considers that you are not authenticated, and redirects to the login page if you use standard Livelink authentication, or to an error page if you use NTLM.

For the HttpWebRequest to behave like a regular browser, you have to provide a way to store the cookie set by LL and provide it back with each subsequent requests. Fortunately the CookieContainer provides this feature.

You were not so far from the grail, I just did the last step :=)

Pierre

De: eLink Discussion: Development Discussion [mailto:development@elinkkc.opentext.com]
Date: lun. 09/07/2007 17:04
À: eLink Recipient
Objet : Thank You!

Thank You!
Posted by Morgan, Daniel on 07/09/2007 11:01 AM

Thanks Pierre!

That worked perfect!

I don't understand it exactly. It looks like you are making two calls to the server. The first request sets the cookie with the server information ignoring the redirect information and the second request uses the new cookie to request the xml file from the server after the clients cookie has forwarded its information.

Is this correct and can you elaborate?

Respectfully,
Dan

[To reply to this thread, use your normal E-mail reply function.]

============================================================

Topic: Using XML Search API in .NET
https://knowledge.opentext.com/knowledge/llisapi.dll/open/3097447

Discussion: Development Discussion
https://knowledge.opentext.com/knowledge/llisapi.dll/open/786303

Livelink Server:
https://knowledge.opentext.com/knowledge/llisapi.dll

To Unsubscribe from this Discussion, send an e-mail to unsubscribe.development@elinkkc.opentext.com.

Daniel__Morgan_(danielmorgan_-_(deleted))

Pierre, I am using the code your provided above but now I am trying to access Livelink using standard Livelink authentication. The issue I am having:During the first pageRequest: Live Link is not setting any cookies so during the second pageRequest it is doing a redirect to a Livelink logon page.The information from the cookies = webResponse.Cookies isCount 0IsReadOnly trueIsSynchronized falseSyncRoot {System.Net.CookieCollection}Non-Public MembersNow cookies count should be 2 - correct?My code is listed below. I am using network credentials to pass my Livelink login and password to Livelink using standard Livelink authentication. If it works as I thought it would then I should get back an XML RSS document. However, it is giving me back a Livelink login page.Any help is always welcome!Respectfully,Dan HttpWebResponse webResponse; HttpWebRequest pageRequest; StreamReader reader; Stream os; String str; CookieCollection cookies = null; string p_UserName = ConfigurationManager.AppSettings["LLUser"]; string p_Password = ConfigurationManager.AppSettings["LLPassword"]; //Create a http request for sd pageRequest = (HttpWebRequest)HttpWebRequest.Create(RequestURL); pageRequest.Credentials = new NetworkCredential(p_UserName, p_Password); pageRequest.AllowAutoRedirect = true; pageRequest.CookieContainer = new CookieContainer(); webResponse = (HttpWebResponse)pageRequest.GetResponse(); cookies = webResponse.Cookies; pageRequest = (HttpWebRequest)HttpWebRequest.Create(RequestURL); pageRequest.Credentials = new NetworkCredential(p_UserName, p_Password); pageRequest.AllowAutoRedirect = true; pageRequest.CookieContainer = new CookieContainer(); pageRequest.CookieContainer.Add(cookies); webResponse = (HttpWebResponse)pageRequest.GetResponse(); string type = webResponse.ContentType; //str = webResponse.ToString(); str = Convert.ToString(webResponse.StatusCode); lblStatus.Text = "Status: " + str; os = webResponse.GetResponseStream(); reader = new StreamReader(os, System.Text.Encoding.UTF8); //TEST - See what Livelink is returning lblResponse.Text = reader.ReadToEnd();//Parse the RSS XmlTextReader xmlReader = new XmlTextReader(reader); XmlDocument xmlDoc = new XmlDocument(); xmlReader.WhitespaceHandling = WhitespaceHandling.None; xmlDoc.Load(xmlReader); xmlReader.Close(); XmlNodeList nodes = xmlDoc.SelectNodes("//item"); foreach (XmlNode item in nodes) { foreach (XmlNode child in item.ChildNodes) { if (child.Name == "title") { rss_title = child.InnerText; } else if (child.Name == "description") { rss_description = child.InnerText; } else if (child.Name == "pubDate") { rss_pubDate = child.InnerText; } else if (child.Name == "link") { rss_link = child.InnerText; } } } } } catch (WebException wx) { lblError.Text = wx.Status.ToString() + ":: Ensure a valid LiveLink RSS Blog URL is being read."; hyprLinkBlog.Visible = false; WebExceptionStatus status = wx.Status; if (status == WebExceptionStatus.ProtocolError) { HttpWebResponse httpResponse = (HttpWebResponse)wx.Response; lblStatus.Text = "Status: " + ((int)httpResponse.StatusCode + "-" + httpResponse.StatusCode); } } catch (Exception ex) { lblError.Text = ex.Message; hyprLinkBlog.Visible = false; } finally { Label lblRssTitle = new Label(); lblRssTitle.Text = rss_title; lblRssTitle.Font.Bold = true; PlaceHolderTitle.Controls.Add(lblRssTitle); Label lblRssPubDate = new Label(); lblRssPubDate.Text = rss_pubDate; PlaceHolderDate.Controls.Add(lblRssPubDate); Label lblRssDesc = new Label(); lblRssDesc.Text = rss_description; PlaceHolderArticle.Controls.Add(lblRssDesc); hyprLinkBlog.NavigateUrl = rss_link; } }

Pierre_Nocera

Message from Pierre Nocera <pnocera@opentext.com> via eLink

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">Accessing Livelink using standard Livelink authentication

Hi Daniel,

If you use standard authentication, I'm afraid there is no other way than passing credentials in the url. something like ....?func=ll.login&username=Admin&password=livelink

Pierre

De: eLink Discussion: Development Discussion [mailto:development@elinkkc.opentext.com]
Date: ven. 13/07/2007 01:52
À: eLink Recipient
Objet : Accessing Livelink using standard Livelink authentication

Accessing Livelink using standard Livelink authentication
Posted by Morgan, Daniel on 07/12/2007 07:47 PM

Pierre, I am using the code your provided above but now I am trying to access Livelink using standard Livelink authentication.

The issue I am having:
During the first pageRequest: Live Link is not setting any cookies so during the second pageRequest it is doing a redirect to a Livelink logon page.

The information from the cookies = webResponse.Cookies is

Count 0
IsReadOnly true
IsSynchronized false
SyncRoot {System.Net.CookieCollection}
Non-Public Members

Now cookies count should be 2 - correct?

My code is listed below. I am using network credentials to pass my Livelink login and password to Livelink using standard Livelink authentication. If it works as I thought it would then I should get back an XML RSS document. However, it is giving me back a Livelink login page.

Any help is always welcome!

Respectfully,
Dan

HttpWebResponse webResponse;
                HttpWebRequest pageRequest;
                StreamReader reader;
                Stream os;
                String str;
                CookieCollection cookies = null;

                string p_UserName = ConfigurationManager.AppSettings["LLUser"];
                string p_Password = ConfigurationManager.AppSettings["LLPassword"];

                //Create a http request for sd
                pageRequest = (HttpWebRequest)HttpWebRequest.Create(RequestURL);
                pageRequest.Credentials = new NetworkCredential(p_UserName, p_Password);
                pageRequest.AllowAutoRedirect = true;
                pageRequest.CookieContainer = new CookieContainer();
                webResponse = (HttpWebResponse)pageRequest.GetResponse();

                cookies = webResponse.Cookies;
                pageRequest = (HttpWebRequest)HttpWebRequest.Create(RequestURL);
                pageRequest.Credentials = new NetworkCredential(p_UserName, p_Password);
                pageRequest.AllowAutoRedirect = true;
                pageRequest.CookieContainer = new CookieContainer();
                pageRequest.CookieContainer.Add(cookies);

                webResponse = (HttpWebResponse)pageRequest.GetResponse();



                string type = webResponse.ContentType;

                //str = webResponse.ToString();
                str = Convert.ToString(webResponse.StatusCode);
                lblStatus.Text = "Status: " + str;


                os = webResponse.GetResponseStream();
                reader = new StreamReader(os, System.Text.Encoding.UTF8);


//TEST - See what Livelink is returning
lblResponse.Text = reader.ReadToEnd();

//Parse the RSS
                XmlTextReader xmlReader = new XmlTextReader(reader);
                XmlDocument xmlDoc = new XmlDocument();

                xmlReader.WhitespaceHandling = WhitespaceHandling.None;

                xmlDoc.Load(xmlReader);
                xmlReader.Close();
                XmlNodeList nodes = xmlDoc.SelectNodes("//item");

                foreach (XmlNode item in nodes)
                {
                    foreach (XmlNode child in item.ChildNodes)
                    {

                        if (child.Name == "title")
                        {
                            rss_title = child.InnerText;
                        }
                        else if (child.Name == "description")
                        {
                            rss_description = child.InnerText;
                        }
                        else if (child.Name == "pubDate")
                        {
                            rss_pubDate = child.InnerText;
                        }
                        else if (child.Name == "link")
                        {
                            rss_link = child.InnerText;
                        }
                    }
                }
            }
        }

        catch (WebException wx)
        {
            lblError.Text = wx.Status.ToString() + ":: Ensure a valid LiveLink RSS Blog URL is being read.";
            hyprLinkBlog.Visible = false;
            WebExceptionStatus status = wx.Status;

            if (status == WebExceptionStatus.ProtocolError)
            {
                HttpWebResponse httpResponse = (HttpWebResponse)wx.Response;
                lblStatus.Text = "Status: " + ((int)httpResponse.StatusCode + "-" + httpResponse.StatusCode);
            }
        }

        catch (Exception ex)
        {
            lblError.Text = ex.Message;
            hyprLinkBlog.Visible = false;
        }

        finally
        {
            Label lblRssTitle = new Label();
            lblRssTitle.Text = rss_title;
            lblRssTitle.Font.Bold = true;
            PlaceHolderTitle.Controls.Add(lblRssTitle);

            Label lblRssPubDate = new Label();
            lblRssPubDate.Text = rss_pubDate;
            PlaceHolderDate.Controls.Add(lblRssPubDate);

            Label lblRssDesc = new Label();
            lblRssDesc.Text = rss_description;
            PlaceHolderArticle.Controls.Add(lblRssDesc);

            hyprLinkBlog.NavigateUrl = rss_link;
        }
    }

[To reply to this thread, use your normal E-mail reply function.]

============================================================

Topic:      Using XML Search API in .NET
https://knowledge.opentext.com/knowledge/llisapi.dll/open/3097447

Discussion: Development Discussion
https://knowledge.opentext.com/knowledge/llisapi.dll/open/786303

Livelink Server:
https://knowledge.opentext.com/knowledge/llisapi.dll

To Unsubscribe from this Discussion, send an e-mail to unsubscribe.development@elinkkc.opentext.com.

Daniel__Morgan_(danielmorgan_-_(deleted))

That was what I was thinking.I guess passing credentials via the url is not very secure though. However, I could create a Livelink "services account" that has VERY restrictive rights. Correct?Question: How would I craft a url to return an XML document / RSS that Livelink would understand?Something like:https://****.xxxxx.com/livelinkext/livelink.exe?func=ll.login&username=servicesacct&password=july13&objId=12345678&objAction=view&outputrss=trueRespectfully,Dan

Mladen_Rangelov

Hi all,

I just had a question if anyone was experiencing a time outs when waiting for a response from the LL server? Every now and then the responses will time out so I was just wondering if anyone had any idea why this may happen. The LL server seems to be working as I can access it directly but the custom search page app pool in iis has to get restarted in order for it to start functioning properly again.

Any thoughts / ideas would be greatly appreciated.

Thanks!