Having recently spoken with a number of large corporations, both in the US and Japan, I have found there is definitely a shortage of engineers in the area of Hadoop and Data/Research Scientists. With the growing interest in the transformative technology called Hadoop and the topic of Big Data applications, many enterprises are scrambling to find developers who understand how to deploy, support and ultimately take advantage of the opportunity this technology represents. Once …
Read more
For those of you not following the Lucene Revolution Blog I’ve posted some updates there about Stump The Chump over the last couple of weeks …
It’s not to late to submit your interesting Solr problem to try and stump me — even if you can’t make it to Boston for the conference.
Read more
The first time I ever presented at an “International Tech Conference” was ApacheCon 2006 in Austin TX. It was the first of many presentations I have given over the years where I practiced, and honed, and rehearsed, for many (many) hours in the weeks leading up to the conference. But in 2010, for the inaugural Lucene Revolution, I thought to myself “What if I do something totally different? What if I do something that will be entirely spontaneous? What if I do something that will be really easy and require no preparation on my part?”
Boy was I wrong…
Read more
There was a video that came out a few years ago called “Did you Know”? If you haven’t seen it, you can check it out on YouTube. I would strongly recommend it. The premise of the video is that everything is exploding and accelerating at the same time–population growth, mountains of information, technology innovation — everything.
What really struck me was that the amount of information contained in one week of the New York …
Read more
If you’re old enough (like me) you may remember the movie “The Mouse that Roared.” Well, here I go—ROAR!!! Amazon, are you listening??
Probably not, which is why I like our chances in this battle.
Amazon announced last week their CloudSearch Beta, which was not a surprise to me since it supports the tremendous interest we’ve seen since we launched our cloud search service 2 months ago.
I can’t tell you how many websites I …
Read more
Lucene / Solr 3.6 has been released and is available for download.
As release manager, here’s my take on the new features:
Read more
I’ve been in a lot of customer meetings lately as well as meeting with high tech press and analysts and all everyone wants to talk about is BIG DATA (arguably one of the biggest technology paradigm shifts since Apple invented the PC). The challenge as I see it like most technology innovations, EVERYONE and their brother is bending their company and product messaging to carve out their portion of the upcoming revenue bonanza.
People are …
Read more
Or, “Trunk can use about 1/3 of the memory required by 3.x”
Please note that these tests were created with an eye toward emphasizing the differences. For instance, I chose to sort on strings since I knew that was an area that would highlight the improvelements. Even so, I’m quite impressed.
If you want to skip all the setup info, drop to the section “Measurement Results”.
Estimating hardware requirements
At Lucid, we often get asked …
Read more
More NOW evil
Prompted by a subtle issue a client raised, I was thinking about date boosting. According to the Wiki, a good way to bost by date is by something like the following:
http://localhost:8983/solr/select?q={!boost b=recip(ms(NOW,manufacturedate_dt),3.16e-11,1,1)}ipod
(see: date boosting link). And this works well, no question.
However, there’s a subtle issue when paging. NOW evaluates to the current time, and every subsequent request will have a different value for NOW. This blog …
Read more
I had the opportunity to be across the pond recently and met with Chris Chant, programme director for the UK Government G-Cloud initiative. Chris is an extremely energetic, funny and very engaging government official who has built a revolutionary marketplace called “The CloudStore”. The CloudStore is the online appstore of the UK Government’s G-Cloud framework for cloud-based IT services. The G-Cloud framework is set to revolutionize the purchasing, management and delivery of public sector IT …
Read more
