Sigmoid Social

Dotan Horovits ✈️ #OSSummit KRDevoxx Poland is just a couple of days away! Join my talk Wednesday at the Data & AI track to learn about the <a href="https://fosstodon.org/tags/OpenSearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSearch</a> project, and how it can provide you search, analytics, observability and vector database capabilities, all <a href="https://fosstodon.org/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource</a> <a href="https://social.lfx.dev/@linuxfoundation" class="u-url mention" rel="nofollow noopener" target="_blank">@linuxfoundation</a> 👉 <a href="https://devoxx.pl/talk-details/?id=8605" rel="nofollow noopener" translate="no" target="_blank">https://devoxx.pl/talk-details/?id=8605</a><a href="https://fosstodon.org/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#data</a> <a href="https://fosstodon.org/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://fosstodon.org/tags/developers" class="mention hashtag" rel="nofollow noopener" target="_blank">#developers</a> <a href="https://fosstodon.org/tags/search" class="mention hashtag" rel="nofollow noopener" target="_blank">#search</a> <a href="https://fosstodon.org/tags/analytics" class="mention hashtag" rel="nofollow noopener" target="_blank">#analytics</a> <a href="https://fosstodon.org/tags/vectordb" class="mention hashtag" rel="nofollow noopener" target="_blank">#vectordb</a> <a href="https://fosstodon.org/tags/observability" class="mention hashtag" rel="nofollow noopener" target="_blank">#observability</a> <a href="https://fosstodon.org/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> <a href="https://fosstodon.org/tags/devoxx" class="mention hashtag" rel="nofollow noopener" target="_blank">#devoxx</a> <a href="https://fosstodon.org/tags/devoxxpl" class="mention hashtag" rel="nofollow noopener" target="_blank">#devoxxpl</a> <a href="https://fosstodon.org/tags/DevoxxPoland" class="mention hashtag" rel="nofollow noopener" target="_blank">#DevoxxPoland</a>

Dotan Horovits ✈️ #OSSummit KR<a href="https://fosstodon.org/tags/OpenSearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSearch</a> 3.0 is out! 🍾 🥳 After 3 years of 2.x, it's time for the next leap, which brings major upgrades to performance, data management, <a href="https://fosstodon.org/tags/vectorDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#vectorDB</a> functionality, and much more. 📈 Upgrade to Apache <a href="https://fosstodon.org/tags/Lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#Lucene</a> 10 and <a href="https://fosstodon.org/tags/JDK" class="mention hashtag" rel="nofollow noopener" target="_blank">#JDK</a> 21+ 📈 Pull-based ingestion for streaming data, with support for Apache <a href="https://fosstodon.org/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> and Amazon <a href="https://fosstodon.org/tags/Kinesis" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kinesis</a> 📈 Power agentic <a href="https://fosstodon.org/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a> with native <a href="https://fosstodon.org/tags/MCP" class="mention hashtag" rel="nofollow noopener" target="_blank">#MCP</a> support 📈 Investigate logs with expanded PPL query tools, backed by Apache <a href="https://fosstodon.org/tags/Calcite" class="mention hashtag" rel="nofollow noopener" target="_blank">#Calcite</a>Check out <a href="https://fosstodon.org/@OpenSearchProject" class="u-url mention" rel="nofollow noopener" target="_blank">@OpenSearchProject</a> blog: <a href="https://opensearch.org/blog/unveiling-opensearch-3-0/" rel="nofollow noopener" translate="no" target="_blank">https://opensearch.org/blog/unveiling-opensearch-3-0/</a>

Philipp Krennnvidia GTC is coming to the bay area next week. we'll be there with a * talk about bringing <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> to the GPU * a "guess that prompt" meetup between galileo + UnstructuredIO + elastic. join us to outsmart AI ;) <a href="https://lu.ma/guess-that-prompt" rel="nofollow noopener" translate="no" target="_blank">https://lu.ma/guess-that-prompt</a>

Philipp Krenn<a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> 9 end of life cleanup 💥 <a href="https://github.com/apache/lucene/pull/13882" rel="nofollow noopener" translate="no" target="_blank">https://github.com/apache/lucene/pull/13882</a>

Nurhak KayaJust blogged about "How to sort items by a <a href="https://umbracocommunity.social/tags/custom" class="mention hashtag" rel="nofollow noopener" target="_blank">#custom</a> date in an <a href="https://umbracocommunity.social/tags/Umbraco" class="mention hashtag" rel="nofollow noopener" target="_blank">#Umbraco</a> v13+ <a href="https://umbracocommunity.social/tags/Examine" class="mention hashtag" rel="nofollow noopener" target="_blank">#Examine</a> Index".<a href="https://www.nurhakkaya.com/2024/10/how-to-sort-items-by-custom-date-in.html" rel="nofollow noopener" translate="no" target="_blank">https://www.nurhakkaya.com/2024/10/how-to-sort-items-by-custom-date-in.html</a><a href="https://umbracocommunity.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> <a href="https://umbracocommunity.social/tags/search" class="mention hashtag" rel="nofollow noopener" target="_blank">#search</a> <a href="https://umbracocommunity.social/tags/umbraco" class="mention hashtag" rel="nofollow noopener" target="_blank">#umbraco</a> <a href="https://umbracocommunity.social/tags/examine" class="mention hashtag" rel="nofollow noopener" target="_blank">#examine</a> <a href="https://umbracocommunity.social/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource</a> <a href="https://umbracocommunity.social/tags/hacktoberfest" class="mention hashtag" rel="nofollow noopener" target="_blank">#hacktoberfest</a> <a href="https://umbracocommunity.social/tags/contribution" class="mention hashtag" rel="nofollow noopener" target="_blank">#contribution</a>

Philipp Krenn<a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> 10 is out: <a href="https://lucene.apache.org/core/corenews.html#apache-lucenetm-1000-available" rel="nofollow noopener" translate="no" target="_blank">https://lucene.apache.org/core/corenews.html#apache-lucenetm-1000-available</a> and the <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#elasticsearch</a> upgrade is already kicking off, starting the countdown for version 9: <a href="https://github.com/elastic/elasticsearch/pull/114741" rel="nofollow noopener" translate="no" target="_blank">https://github.com/elastic/elasticsearch/pull/114741</a>

Charlie HullSome people blog about K8s, I prefer to blog about K9. <a href="https://opensourceconnections.com/blog/2024/10/10/dogfights-in-open-source-search-solr-opensearch-and-elasticsearch/" rel="nofollow noopener" translate="no" target="_blank">https://opensourceconnections.com/blog/2024/10/10/dogfights-in-open-source-search-solr-opensearch-and-elasticsearch/</a> <a href="https://hachyderm.io/tags/solr" class="mention hashtag" rel="nofollow noopener" target="_blank">#solr</a> <a href="https://hachyderm.io/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#elasticsearch</a> <a href="https://hachyderm.io/tags/opensearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensearch</a> <a href="https://hachyderm.io/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource</a> <a href="https://hachyderm.io/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a>

Dalatangi<a href="https://cosocial.ca/@timbray" class="u-url mention" rel="nofollow noopener" target="_blank">@timbray</a> The dk.brics.automaton Java library comes to my mind immediately. Very minimalistic, incredibly fast and efficient (C-like code actually) and only Junit test dependencies. <a href="https://github.com/cs-au-dk/dk.brics.automaton" rel="nofollow noopener" translate="no" target="_blank">https://github.com/cs-au-dk/dk.brics.automaton</a><a href="https://www.brics.dk/automaton/" rel="nofollow noopener" translate="no" target="_blank">https://www.brics.dk/automaton/</a>Plus, it is widely used in e.g. <a href="https://fosstodon.org/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> and via this in things like <a href="https://fosstodon.org/tags/solr" class="mention hashtag" rel="nofollow noopener" target="_blank">#solr</a> or <a href="https://fosstodon.org/tags/ElasticSearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#ElasticSearch</a>

Philipp Krenn8️⃣.0️⃣ approximate kNN search based on HNSW with float vectors on the _knn endpoint. this like many other (but not all) changes is based on improvements in <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> 3/18

Erik C. ThauvinElasticsearch is Open Source, Again<a href="https://mastodon.social/tags/amazon" class="mention hashtag" rel="nofollow noopener" target="_blank">#amazon</a> <a href="https://mastodon.social/tags/apache" class="mention hashtag" rel="nofollow noopener" target="_blank">#apache</a> <a href="https://mastodon.social/tags/java" class="mention hashtag" rel="nofollow noopener" target="_blank">#java</a> <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> <a href="https://mastodon.social/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource</a><a href="https://www.elastic.co/blog/elasticsearch-is-open-source-again?utm_medium=erik.in&utm_source=mastodon" rel="nofollow noopener" translate="no" target="_blank">https://www.elastic.co/blog/elasticsearch-is-open-source-again?utm_medium=erik.in&utm_source=mastodon</a>

dadaVous sauriez s'il existe une option dans une Lucene Query de Grafana de passer une variable de majuscule à minuscule ou inversement ?J'ai une variable Grafana que le user doit renseigner en majuscule mais qui doit être exploitée en minuscule dans des graphiques...<a href="https://diaspodon.fr/tags/aide" class="mention hashtag" rel="nofollow noopener" target="_blank">#aide</a> <a href="https://diaspodon.fr/tags/grafana" class="mention hashtag" rel="nofollow noopener" target="_blank">#grafana</a> <a href="https://diaspodon.fr/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a>

Philipp Krennapproximate kNN search: * good estimate * you can control speed vs precision through the num_candidates setting (basically overfetching on the approximation for getting very close to exact kNN) * <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> uses HNSW: think of it as highways, roads & streets 🛣️ 3/9

Philipp Krenngreat validation on all the progress <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#elasticsearch</a> and <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> have made as a vector database (besides all the other features and improvements) guess we'll "just" have to do a lot more shouting about it 📣 <a href="https://reddit.com/r/elasticsearch/comments/1d3xtds/is_elastic_search_better_than_chromadb/" rel="nofollow noopener" translate="no" target="_blank">https://reddit.com/r/elasticsearch/comments/1d3xtds/is_elastic_search_better_than_chromadb/</a>

Dave MackeyAny friends (or potential friends :)) in <a href="https://hachyderm.io/tags/stockholm" class="mention hashtag" rel="nofollow noopener" target="_blank">#stockholm</a> ? I'll be in Stockholm and have some availability to meet up. Interested in connecting in general as well as with folks in <a href="https://hachyderm.io/tags/search" class="mention hashtag" rel="nofollow noopener" target="_blank">#search</a>, <a href="https://hachyderm.io/tags/informationretrieval" class="mention hashtag" rel="nofollow noopener" target="_blank">#informationretrieval</a>, <a href="https://hachyderm.io/tags/knowledgemanagement" class="mention hashtag" rel="nofollow noopener" target="_blank">#knowledgemanagement</a>, <a href="https://hachyderm.io/tags/library" class="mention hashtag" rel="nofollow noopener" target="_blank">#library</a> sciences.<a href="https://hachyderm.io/tags/sweden" class="mention hashtag" rel="nofollow noopener" target="_blank">#sweden</a> <a href="https://hachyderm.io/tags/elastic" class="mention hashtag" rel="nofollow noopener" target="_blank">#elastic</a> <a href="https://hachyderm.io/tags/ElasticSearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#ElasticSearch</a> <a href="https://hachyderm.io/tags/opensearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensearch</a> <a href="https://hachyderm.io/tags/solr" class="mention hashtag" rel="nofollow noopener" target="_blank">#solr</a> <a href="https://hachyderm.io/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> <a href="https://hachyderm.io/tags/ir" class="mention hashtag" rel="nofollow noopener" target="_blank">#ir</a>

Philipp Krennpgvector 0.7 is out: <a href="https://www.postgresql.org/about/news/pgvector-070-released-2852/" rel="nofollow noopener" translate="no" target="_blank">https://www.postgresql.org/about/news/pgvector-070-released-2852/</a> 1. never forget about <a href="https://mastodon.social/tags/postgresql" class="mention hashtag" rel="nofollow noopener" target="_blank">#postgresql</a> 2. fascinating what the "right" quantization / granularity per vector dimension is for each system. postgres picks 4 and 2 byte plus 1 bit. whereas <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> / <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#elasticsearch</a> are going for 4 and 1 byte plus 4 bit. who can pick the right tradeoffs here?

Alexander ReelsenZulia Search Engine: Another Lucene based distributed search engine, that is written in Java. Using MongoDB in cluster mode for metadata sharing/node management it seems. Seems to be tailored for a certain use-case due to not having a lot of analyzers exposed. Communicating via GRPC.Did not spot anything regarding distributed error handling and documentation is relatively sparse.Lucene is here to stay and going nowhere. <a href="https://mastodon.social/tags/search" class="mention hashtag" rel="nofollow noopener" target="_blank">#search</a> <a href="https://mastodon.social/tags/java" class="mention hashtag" rel="nofollow noopener" target="_blank">#java</a> <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a><a href="https://github.com/zuliaio/zuliasearch" rel="nofollow noopener" translate="no" target="_blank">https://github.com/zuliaio/zuliasearch</a>

Marc R. HoffmannIs there really cheese in Java?The <a href="https://javabubble.social/tags/javaalmanac" class="mention hashtag" rel="nofollow noopener" target="_blank">#javaalmanac</a> now has full text search 🥳Search JavaDoc, JEPs, language and JVM specs across versions.<a href="https://javaalmanac.io/find/?q=cheese" rel="nofollow noopener" translate="no" target="_blank">https://javaalmanac.io/find/?q=cheese</a><a href="https://javabubble.social/tags/openjdk" class="mention hashtag" rel="nofollow noopener" target="_blank">#openjdk</a> <a href="https://javabubble.social/tags/java" class="mention hashtag" rel="nofollow noopener" target="_blank">#java</a> <a href="https://javabubble.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a>

Philipp Krennthere are a lot of vector similarities: dot product, euclidean, max inner product, hamming distance,... how to support more in <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> while keeping it tested and benchmarked? plugins — PR in progress with two different groups: <a href="https://github.com/apache/lucene/pull/13288" rel="nofollow noopener" translate="no" target="_blank">https://github.com/apache/lucene/pull/13288</a> * core: currently including dot product, euclidean, and max inner product * lucene codecs (similar to compression extensions): starting with hamming distance also cleaning up with generics and maybe allowing more native code optimizations later on

Philipp Krenn<a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> 10 is starting to shape up: <a href="https://lists.apache.org/thread/4bhnkkvvodxxgrpj4yqm5yrgj0ppc59r" rel="nofollow noopener" translate="no" target="_blank">https://lists.apache.org/thread/4bhnkkvvodxxgrpj4yqm5yrgj0ppc59r</a> 🙌

Philipp Krennsearching HNSW in parallel on <a href="https://mastodon.social/tags/lucene" class="mention hashtag" rel="nofollow noopener" target="_blank">#lucene</a> 9.10 and then <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#elasticsearch</a> got a great speedup for all your (dense) vector fields: <a href="https://github.com/apache/lucene/pull/12962" rel="nofollow noopener" translate="no" target="_blank">https://github.com/apache/lucene/pull/12962</a> merging to a single segment will still be faster but the difference is getting much smaller. moar smart optimizations :)

Recent searches

Search options

Administered by:

Server stats:

#lucene