• Products
    • Overview
    • LucidWorks Search Platform
      • Features and Benefits
      • Technical Overview
      • Only with LucidWorks
      • LucidWorks and Solr
      • White Papers
      • LucidWorks Enterprise
      • LucidWorks Cloud
      • LucidWorks Big Data
    • Apache Releases
      • Apache Solr 4.0-dev
      • Apache Lucene
  • Support & Services
    • Overview
    • Support
    • Lucid University
    • ExpertLink Advisory
    • Consulting
    • Partners
    • Subscriptions
  • Why Lucid?
    • Why Lucid?
    • Technology
    • Who uses Lucene/Solr?
      • What customers are saying
    • Case Studies
    • Whitepapers
    • Demos
    • Webinars
  • Blog
  • DevZone
    • DevZone Overview
    • Forums (LWE)
    • Videos & Podcasts
      • How To's
      • Screencasts
      • Podcasts
      • Conference Videos
    • Technical Articles
      • Whitepapers
    • Reference Materials
      • Documentation
      • Solr Reference Guide
      • Solr & LucidWorks Matrix
      • Tutorials
    • Events
      • Lucene Revolution
      • Tradeshows & Conferences
      • Meet Ups
    • Code & Test
  • Downloads
  • About Us
    • Management
    • Board of Directors
    • Apache Lucene/Solr Committers
    • Careers
    • News
      • Media Coverage
      • Press Releases
    • Contact Us
Log in
Home . DevZone . Forum

Lucid Imagination Forum » LucidWorks Enterprise

Problem getting SharePoint connector set up

(8 posts) (2 voices)
  • Started 4 months ago by christopher.o.gross
  • Latest reply from christopher.o.gross

Tags:

  • LWE 2.0.1
  • SharePoint 2010
  1. christopher.o.gross
    Member

    I get the following error when trying to set up crawling for a SharePoint site:

    There was a problem creating that data source: root URL is unreachable: Cannot connect to the given SharePoint Site URL with the supplied Domain/Username/Password.Reason:(403)Forbidden

    The username and password I have provided are valid, and the link is as well.  Through a browser, I can get connected just fine.  The SharePoint site has the latest (2.8) Google Sharepoint connectors set up.

    Is there a logfile that I should be looking for to get a better idea of what is happening here?

    Any help would be appreciated.  Thanks!

    -- Christopher Gross

    Posted 4 months ago #
  2. christopher.o.gross
    Member

    Digging deeper, I was able to find this:

    2012-01-18 20:18:46 10.2.158.59 POST /_vti_bin/Webs.asmx - 80 - 10.4.20.109 Axis/1.4 403 0 0 31

    What I don't understand is why I can get to that URL from my browser (did a Chrome Incognito to hide my user info) and it worked just fine.  Does anyone have any ideas on what to do?

    Thanks!

    Posted 4 months ago #
  3. Lance
    Professional Services Engineer

    Hello-

    • Is there a short snippet of the log file that you can add? (We don't have attachments on the forum.)
    • You can log in via the browser. Can you try doing a POST with the curl program? If everything is an url parameter, you can just do the post with the parameters in the URL. (I think.) Or, you can look at the web source and match the FORM input.
    • Where is the Sharepoint installation? Is it possible that it uses IP address authentication that works from your browser but not where LWE is installed?
    • You reported a similar problem 9 months ago. Did you solve that problem? Is it anything like this?
    •     http://www.lucidimagination.com/forum/lwe/gssitediscoveryws-forbidden-error
    Posted 4 months ago #
  4. Lance
    Professional Services Engineer

    DId you make the configuration based on this?

    http://lucidworks.lucidimagination.com/display/help/Create+a+New+SharePoint+Data+Source

    Posted 4 months ago #
  5. christopher.o.gross
    Member

    Hi Lance.

    Log Snippet:

     

    2012-01-19 13:51:09,195 DEBUG wire.header - >> "POST /sites/mlogic/_vti_bin/Webs.asmx HTTP/1.1[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.header - >> "Content-Type: text/xml; charset=utf-8[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.header - >> "SOAPAction: "http://schemas.microsoft.com/sharepoint/soap/GetWebCollection"[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.header - >> "User-Agent: Axis/1.4[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.header - >> "Host: xxxxxxxxxxxxxxxxxxxx[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.header - >> "Transfer-Encoding: chunked[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.header - >> "[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.content - >> "14e[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.content - >> "<?xml version="1.0" encoding="UTF-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><soapenv:Body><GetWebCollection xmlns="http://schemas.microsoft.com/sharepoint/soap/"/></soapenv:Body></soapenv:Envelope>"
    2012-01-19 13:51:09,195 DEBUG wire.content - >> "[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.content - >> "0"
    2012-01-19 13:51:09,195 DEBUG wire.content - >> "[\r][\n]"
    2012-01-19 13:51:09,195 DEBUG wire.content - >> "[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "HTTP/1.1 403 Forbidden[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "HTTP/1.1 403 Forbidden[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "Cache-Control: private, max-age=0[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "Server: Microsoft-IIS/7.5[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "SPRequestGuid: 8d74f10c-8524-4a51-a9fb-84f034e4baa7[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "X-SharePointHealthScore: 0[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "X-Forms_Based_Auth_Required: http://xxxxxxxxxxxxxxxxxxxx/_login/default.aspx?ReturnUrl=/_layouts/Error.aspx&Source=%2f_vti_bin%2fWebs.asmx\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "X-Forms_Based_Auth_Return_Url: http://xxxxxxxxxxxxxxxxxxxx/_layouts/Error.aspx\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "X-MSDAVEXT_Error: 917656; Access denied. Before opening files in this location, you must first browse to the web site and select the option to login automatically.[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "X-AspNet-Version: 2.0.50727[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "X-Powered-By: ASP.NET[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "MicrosoftSharePointTeamServices: 14.0.0.4762[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "Date: Thu, 19 Jan 2012 13:52:07 GMT[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "Content-Length: 13[\r][\n]"
    2012-01-19 13:51:09,211 DEBUG wire.header - << "[\r][\n]"
    2012-01-19 13:51:09,226 DEBUG wire.content - << "403 FORBIDDEN"
    2012-01-19 13:51:09,226 WARN wsclient.WebsWS - Unable to connect.
    AxisFault
    faultCode: {http://xml.apache.org/axis/}HTTP
    faultSubcode:
    faultString: (403)Forbidden
    faultActor:
    faultNode:
    faultDetail:
    {}:return code: 403
    403 FORBIDDEN
    {http://xml.apache.org/axis/}HttpErrorCode:403

    (403)Forbidden
    at org.apache.axis.transport.http.CommonsHTTPSender.invoke(CommonsHTTPSender.java:218)
    at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32)
    at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
    at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83)
    at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165)
    at org.apache.axis.client.Call.invokeEngine(Call.java:2784)
    at org.apache.axis.client.Call.invoke(Call.java:2767)
    at org.apache.axis.client.Call.invoke(Call.java:2443)
    at org.apache.axis.client.Call.invoke(Call.java:2366)
    at org.apache.axis.client.Call.invoke(Call.java:1812)
    at com.google.enterprise.connector.sharepoint.generated.webs.WebsSoap_BindingStub.getWebCollection(WebsSoap_BindingStub.java:816)
    at com.google.enterprise.connector.sharepoint.wsclient.WebsWS.checkConnectivity(WebsWS.java:271)
    at com.google.enterprise.connector.sharepoint.spiimpl.SharepointConnectorType.checkConnectivity(SharepointConnectorType.java:1181)
    at com.google.enterprise.connector.sharepoint.spiimpl.SharepointConnectorType.validateConfigMap(SharepointConnectorType.java:626)
    at com.google.enterprise.connector.sharepoint.spiimpl.SharepointConnectorType.validateConfig(SharepointConnectorType.java:750)
    at com.google.enterprise.connector.sharepoint.spiimpl.SharepointConnectorType.validateConfig(SharepointConnectorType.java:738)
    at com.google.enterprise.connector.instantiator.ConnectorCoordinatorImpl.validateConfig(ConnectorCoordinatorImpl.java:747)
    at com.google.enterprise.connector.instantiator.ConnectorCoordinatorImpl.resetConfig(ConnectorCoordinatorImpl.java:706)
    at com.google.enterprise.connector.instantiator.ConnectorCoordinatorImpl.createNewConnector(ConnectorCoordinatorImpl.java:680)
    at com.google.enterprise.connector.instantiator.ConnectorCoordinatorImpl.setConnectorConfig(ConnectorCoordinatorImpl.java:405)
    at com.google.enterprise.connector.instantiator.SpringInstantiator.setConnectorConfig(SpringInstantiator.java:239)
    at com.google.enterprise.connector.manager.ProductionManager.setConnectorConfig(ProductionManager.java:203)
    at com.google.enterprise.connector.servlet.SetConnectorConfigHandler.<init>(SetConnectorConfigHandler.java:104)
    at com.google.enterprise.connector.servlet.SetConnectorConfig.processDoPost(SetConnectorConfig.java:36)
    at com.google.enterprise.connector.servlet.ConnectorManagerServlet.doPost(ConnectorManagerServlet.java:96)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
    at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
    at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
    at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
    at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
    at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
    at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
    at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
    at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
    at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
    at org.mortbay.jetty.Server.handle(Server.java:322)
    at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
    at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
    at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
    at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
    at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
    at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
    at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
    2012-01-19 13:51:09,226 WARN instantiator.ConnectorCoordinatorImpl - A rejected configuration for connector tmp--1426626724 was returned.

    Is there another section that would be helpful?

    I don't know what arguments to pass to make it work using curl.

    The SharePoint is installed on a test server, but my LWE is on my box, where I am able to connect via the browser, so I'm pretty sure that it should go through.  I wasn't sure if there were settings for LWE that would be causing a problem.  I don't manage the SharePoint either, we have a team devoted to that.

    I've had a busy 9 months, and this is a different setup then that one.  I eventually had it sort of working, but I wasn't getting all the data from SharePoint.

    I did use that page to try to get set up, but it didn't have anything relating to the error that I'm getting.

    Thanks Lance, let me know if there is anything else that I can provide that would help.

    Posted 4 months ago #
  6. Lance
    Professional Services Engineer

    This page details how to set up a Sharepoint for crawling. You have to copy several files from LWE to the Sharepoint install.

    http://lucidworks.lucidimagination.com/display/lweug/Data+Sources#DataSources-lucid.gcm

    We also have file system and SMB/CIFS crawling, if that is possible in your site.

    Posted 4 months ago #
  7. Lance
    Professional Services Engineer

    I posted the wrong link in the above message. It is:

    http://lucidworks.lucidimagination.com/display/lweug/Data+Sources#DataSources-lucid.gcm

    Posted 4 months ago #
  8. christopher.o.gross
    Member

    Hi Lance.

    I'm still getting a 403 error.  I'm pretty sure that I'm giving the correct password (tried logging in via the browser).  The only thing that the link you sent that is different is to use the packaged asmx files instead of ones from Google.  So I've done that, but still no luck.  Perhaps there are SharePoint settings that need to be changed?  Or something with my user that needs to be changed?

    I was able to get the crawler to work before, but I figured that the SharePoint connector would be more timely.

    Thanks!

    Posted 3 months ago #

RSS feed for this topic

Reply

You must log in to post.

  • Contact Us
  • About Lucid Imagination
  • Help & Support
  • Training
  • Website Feedback
  • Privacy Policy
  • Legal Terms of Use
  • Copyrights and Disclaimers
  • Sitemap
  • Admin

Apache Solr, Solr, Apache Lucene, Lucene and their logos are trademarks of the Apache Software Foundation.

© 2012 Lucid Imagination. All Right reserved.