<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: State of Spatial Support in Apache Solr</title>
	<atom:link href="http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/</link>
	<description>Exclusively dedicated to Apache Lucene/Solr open source search technology</description>
	<lastBuildDate>Sat, 04 Feb 2012 01:13:03 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3</generator>
	<item>
		<title>By: Update on Spatial support in Apache Solr and Lucene &#124; Lucene Revolution</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-6723</link>
		<dc:creator>Update on Spatial support in Apache Solr and Lucene &#124; Lucene Revolution</dc:creator>
		<pubDate>Wed, 08 Dec 2010 11:52:12 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-6723</guid>
		<description>[...] To know more visit: Lucid Imagination [...]</description>
		<content:encoded><![CDATA[<p>[...] To know more visit: Lucid Imagination [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Terence Gannon</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5628</link>
		<dc:creator>Terence Gannon</dc:creator>
		<pubDate>Thu, 19 Aug 2010 14:40:39 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5628</guid>
		<description>That&#039;s good info, Grant, thank you.</description>
		<content:encoded><![CDATA[<p>That&#8217;s good info, Grant, thank you.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Grant Ingersoll</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5627</link>
		<dc:creator>Grant Ingersoll</dc:creator>
		<pubDate>Thu, 19 Aug 2010 14:18:53 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5627</guid>
		<description>Hi Terence,

http://wiki.apache.org/solr/SpatialSearch contains most of the detail about Spatial.  Also, there are specific JIRA issues cited above (start with SOLR-773).  Also, see http://www.lucidimagination.com/blog/2010/07/20/update-spatial-search-in-apache-lucene-and-solr/

I don&#039;t have much at this point on shape intersections other than it would be nice to be able to build up more complex bounding boxes, etc. for filtering based on shapes and intersections with multiple shapes.

As for geocoding, I think we need tools that can translate addresses, etc. into lat/lon, etc.  Geonames is a possible starting place.  I imagine Open Streets has some capability too.  I haven&#039;t looked too much into it yet.</description>
		<content:encoded><![CDATA[<p>Hi Terence,</p>
<p><a href="http://wiki.apache.org/solr/SpatialSearch" rel="nofollow">http://wiki.apache.org/solr/SpatialSearch</a> contains most of the detail about Spatial.  Also, there are specific JIRA issues cited above (start with SOLR-773).  Also, see <a href="http://www.lucidimagination.com/blog/2010/07/20/update-spatial-search-in-apache-lucene-and-solr/" rel="nofollow">http://www.lucidimagination.com/blog/2010/07/20/update-spatial-search-in-apache-lucene-and-solr/</a></p>
<p>I don&#8217;t have much at this point on shape intersections other than it would be nice to be able to build up more complex bounding boxes, etc. for filtering based on shapes and intersections with multiple shapes.</p>
<p>As for geocoding, I think we need tools that can translate addresses, etc. into lat/lon, etc.  Geonames is a possible starting place.  I imagine Open Streets has some capability too.  I haven&#8217;t looked too much into it yet.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Terence Gannon</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5614</link>
		<dc:creator>Terence Gannon</dc:creator>
		<pubDate>Tue, 17 Aug 2010 14:04:17 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5614</guid>
		<description>Do any more detailed requirements documents exist for these two items?  Perhaps what we should be thinking of contributing new functionality to Solr, rather than building a new, standalone component.  Thoughts?</description>
		<content:encoded><![CDATA[<p>Do any more detailed requirements documents exist for these two items?  Perhaps what we should be thinking of contributing new functionality to Solr, rather than building a new, standalone component.  Thoughts?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Grant Ingersoll</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5612</link>
		<dc:creator>Grant Ingersoll</dc:creator>
		<pubDate>Tue, 17 Aug 2010 11:18:46 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5612</guid>
		<description>Hi Terence,

RE the example on hydraulic fracturing, this is already something that Solr supports in the current trunk.  Some things Solr still needs in the way of spatial are:
1. Geocoding query parser and indexing components
2. Shape intersections, etc.</description>
		<content:encoded><![CDATA[<p>Hi Terence,</p>
<p>RE the example on hydraulic fracturing, this is already something that Solr supports in the current trunk.  Some things Solr still needs in the way of spatial are:<br />
1. Geocoding query parser and indexing components<br />
2. Shape intersections, etc.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Terence Gannon</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5610</link>
		<dc:creator>Terence Gannon</dc:creator>
		<pubDate>Mon, 16 Aug 2010 20:43:50 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5610</guid>
		<description>Perhaps I should back up a step or two and provide some context for my initial question to Grant.  The basic requirement which I want to address is search which permits both content and geospatial criteria to be specified and have results returned that meet both of those criteria.

The origin of this requirement is the oil &amp; gas industry, and specifically data related to &lt;a href=&quot;http://en.wikipedia.org/wiki/Hydraulic_fracturing&quot; rel=&quot;nofollow&quot;&gt;hydraulic fracturing&lt;/a&gt;.  These are expensive treatments (millions of dollar per well in some cases) so it&#039;s desirable to increase the odds of success by looking at relevant treatment information from past jobs.  Something along the lines of &quot;show me all treatment information where chemical x and process y were used, but only as it relates to the Montney formation within 10 kilometres of the well in question.&quot;  In this example, chemical x and process y are content-based criteria and &quot;Montney&quot; and &quot;within 10 kilometres&quot; are geospatial criteria.

The theory would be to develop a component which would parse out the two kinds of criteria and send them off in their respective subsystems for handling.  Solr for content-based criteria and whatever-the-geospatical-engine-would-be for the geospatial criteria.  The two systems would process the queries and return results to the newly-developed component, which would take responsibility for integrating the two sets of results and presenting them back to the user.  Ideally, the new component would do all of this without touching the code based of either of the subsystems it calls, so there are no licensing entanglements.

Let me know if that helps, or if there is more information you require.  The main objective is to only develop what&#039;s absolutely required, and not re-invent any wheel which already exists.  Thanks for your help!  Cheers...TCG</description>
		<content:encoded><![CDATA[<p>Perhaps I should back up a step or two and provide some context for my initial question to Grant.  The basic requirement which I want to address is search which permits both content and geospatial criteria to be specified and have results returned that meet both of those criteria.</p>
<p>The origin of this requirement is the oil &amp; gas industry, and specifically data related to <a href="http://en.wikipedia.org/wiki/Hydraulic_fracturing" rel="nofollow">hydraulic fracturing</a>.  These are expensive treatments (millions of dollar per well in some cases) so it&#8217;s desirable to increase the odds of success by looking at relevant treatment information from past jobs.  Something along the lines of &#8220;show me all treatment information where chemical x and process y were used, but only as it relates to the Montney formation within 10 kilometres of the well in question.&#8221;  In this example, chemical x and process y are content-based criteria and &#8220;Montney&#8221; and &#8220;within 10 kilometres&#8221; are geospatial criteria.</p>
<p>The theory would be to develop a component which would parse out the two kinds of criteria and send them off in their respective subsystems for handling.  Solr for content-based criteria and whatever-the-geospatical-engine-would-be for the geospatial criteria.  The two systems would process the queries and return results to the newly-developed component, which would take responsibility for integrating the two sets of results and presenting them back to the user.  Ideally, the new component would do all of this without touching the code based of either of the subsystems it calls, so there are no licensing entanglements.</p>
<p>Let me know if that helps, or if there is more information you require.  The main objective is to only develop what&#8217;s absolutely required, and not re-invent any wheel which already exists.  Thanks for your help!  Cheers&#8230;TCG</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Adam Estrada</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5601</link>
		<dc:creator>Adam Estrada</dc:creator>
		<pubDate>Sun, 15 Aug 2010 21:25:40 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5601</guid>
		<description>All,

Geoserver is an application that allows you to publish geospatial data in OGC-compliant formats like WMS, WCS, WFS, KML, etc...The data &quot;sources&quot; can be flat file data sets like GML, Shapefiles, KML or external relational databases like Oracle Spatial and Postgresql/PostGIS. There is also support for raster data which can be stored in the index but not in it&#039;s native form.

Geoserver at the core, uses several other Open Source libraries like GEOS/JTS, PROJ4 and GDAL to read and translate the data. I  believe that implementing these technologies in to Solr core would be more beneficial than trying to make the index work with Geoserver. After actually writing that, I question what the best approach is for this endeavor.

1. Integrating Solr in to Geoserver would provide some really great advanced search capabilities to the application. but...
2. Integrating some of the aforementioned libraries in to Solr would essentially make Solr an indexer for geospatial data which could potentially surpass the performance of relational databases. 

Geoserver does not necessarily allow you to perform all the predicate geometry functions like buffering and intersecting of features. Again, you would have to rely on something like the JTS to perform these operations on any geometries stored in the index.

Given that Solr is so easy to extend, it would be relatively painless to return geometries stored in the index as various other file formats (OGC compliant or not). Check out the GeoTools Suite (http://www.osgeo.org/geotools) from the same company who developed Geoserver. They wrap a lot of the underlying functionality that Solr would need in to a nice single package.

There are many many directions to go from here and I am *very* interested to see more geospatial support in these awesome Apache projects. Please let me know what I can do to help ;-)

Kindest Regards,
Adam</description>
		<content:encoded><![CDATA[<p>All,</p>
<p>Geoserver is an application that allows you to publish geospatial data in OGC-compliant formats like WMS, WCS, WFS, KML, etc&#8230;The data &#8220;sources&#8221; can be flat file data sets like GML, Shapefiles, KML or external relational databases like Oracle Spatial and Postgresql/PostGIS. There is also support for raster data which can be stored in the index but not in it&#8217;s native form.</p>
<p>Geoserver at the core, uses several other Open Source libraries like GEOS/JTS, PROJ4 and GDAL to read and translate the data. I  believe that implementing these technologies in to Solr core would be more beneficial than trying to make the index work with Geoserver. After actually writing that, I question what the best approach is for this endeavor.</p>
<p>1. Integrating Solr in to Geoserver would provide some really great advanced search capabilities to the application. but&#8230;<br />
2. Integrating some of the aforementioned libraries in to Solr would essentially make Solr an indexer for geospatial data which could potentially surpass the performance of relational databases. </p>
<p>Geoserver does not necessarily allow you to perform all the predicate geometry functions like buffering and intersecting of features. Again, you would have to rely on something like the JTS to perform these operations on any geometries stored in the index.</p>
<p>Given that Solr is so easy to extend, it would be relatively painless to return geometries stored in the index as various other file formats (OGC compliant or not). Check out the GeoTools Suite (<a href="http://www.osgeo.org/geotools" rel="nofollow">http://www.osgeo.org/geotools</a>) from the same company who developed Geoserver. They wrap a lot of the underlying functionality that Solr would need in to a nice single package.</p>
<p>There are many many directions to go from here and I am *very* interested to see more geospatial support in these awesome Apache projects. Please let me know what I can do to help <img src='http://www.lucidimagination.com/blog/wp-includes/images/smilies/icon_wink.gif' alt=';-)' class='wp-smiley' /> </p>
<p>Kindest Regards,<br />
Adam</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Grant Ingersoll</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5597</link>
		<dc:creator>Grant Ingersoll</dc:creator>
		<pubDate>Fri, 13 Aug 2010 15:35:40 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5597</guid>
		<description>Hi Terence,

I&#039;m not an expert in GeoServer.  I&#039;m a little unsure, however, of what you mean by &quot;full geospatial capabilities from the get go&quot;.  What proposed features does GeoServer have that would help solve spatial search problems?  From my naive view, it seems that geoserver mainly deals with storing and managing map data and then displaying it.  Can it do things like shape intersections, bounding box calculations, geocoding, etc.?

Also, as far as adding any specific integration code into the Solr core, the GPL license is a show stopper.  Naturally, that doesn&#039;t prevent it from being hosted elsewhere, it just means we can&#039;t commit any code that has a dependency on GeoServer to the Solr code base.

HTH,
Grant

Cheers,
Grant</description>
		<content:encoded><![CDATA[<p>Hi Terence,</p>
<p>I&#8217;m not an expert in GeoServer.  I&#8217;m a little unsure, however, of what you mean by &#8220;full geospatial capabilities from the get go&#8221;.  What proposed features does GeoServer have that would help solve spatial search problems?  From my naive view, it seems that geoserver mainly deals with storing and managing map data and then displaying it.  Can it do things like shape intersections, bounding box calculations, geocoding, etc.?</p>
<p>Also, as far as adding any specific integration code into the Solr core, the GPL license is a show stopper.  Naturally, that doesn&#8217;t prevent it from being hosted elsewhere, it just means we can&#8217;t commit any code that has a dependency on GeoServer to the Solr code base.</p>
<p>HTH,<br />
Grant</p>
<p>Cheers,<br />
Grant</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Terence Gannon</title>
		<link>http://www.lucidimagination.com/blog/2010/03/10/state-of-spatial-support-in-apache-solr/comment-page-1/#comment-5214</link>
		<dc:creator>Terence Gannon</dc:creator>
		<pubDate>Fri, 23 Jul 2010 17:35:29 +0000</pubDate>
		<guid isPermaLink="false">http://www.lucidimagination.com/blog/?p=1846#comment-5214</guid>
		<description>Grant -- somewhat related to the above, we are giving some consideration to initiating an effort which would marry together the capabilities of Solr with GeoServer (geoserver.org), the latter being a pure Java open source geospatial server.  The preliminary idea would be to build an open source component which would interoperate with Solr and GeoServer.  The proposed component would parse out the search criteria (dividing them into criteria for Solr and criteria for GeoServer) send off the requests to Solr and GeoServer servers respectively and then integrate the two result sets and send the net result back to the calling application.

What I&#039;m wondering is whether such an effort would be complementary to what you&#039;re doing with Solr as described above?  Obviously, I&#039;m looking to stay on the right side of Solr development effort and would not want to charge off in a direction which did not complement your efforts in some way.  The perceived benefit of the Solr/GeoServer idea is that you have the full geospatial capabilities from the get go, as opposed to having to build them over time.

Any thoughts or comments you have in this regard are most welcome.  Thanks and best regards...

Terence Gannon
Intellog Inc.</description>
		<content:encoded><![CDATA[<p>Grant &#8212; somewhat related to the above, we are giving some consideration to initiating an effort which would marry together the capabilities of Solr with GeoServer (geoserver.org), the latter being a pure Java open source geospatial server.  The preliminary idea would be to build an open source component which would interoperate with Solr and GeoServer.  The proposed component would parse out the search criteria (dividing them into criteria for Solr and criteria for GeoServer) send off the requests to Solr and GeoServer servers respectively and then integrate the two result sets and send the net result back to the calling application.</p>
<p>What I&#8217;m wondering is whether such an effort would be complementary to what you&#8217;re doing with Solr as described above?  Obviously, I&#8217;m looking to stay on the right side of Solr development effort and would not want to charge off in a direction which did not complement your efforts in some way.  The perceived benefit of the Solr/GeoServer idea is that you have the full geospatial capabilities from the get go, as opposed to having to build them over time.</p>
<p>Any thoughts or comments you have in this regard are most welcome.  Thanks and best regards&#8230;</p>
<p>Terence Gannon<br />
Intellog Inc.</p>
]]></content:encoded>
	</item>
</channel>
</rss>

