Questions tagged [elasticsearch]

Elasticsearch is an Open Source (Apache 2), Distributed, RESTful, Search Engine based on Lucene.

0
votes
0answers
4 views

Problem running logstash in aws ec2 linux ami

I am setting up "elasticsearch" in AWS, i am trying to use AWS linux AMI. When i run the bin/logstash -f "/path to config file" i get error saying: "logstash.yml" not found try using "--path.settings"...
0
votes
0answers
5 views

why does logstash stops processing logs

Logstash stops processing logs after some hours. When logs stops processing logstash service consumes high amount of CPU performance (about 25 cores of 32 total). When logstash service works normal it ...
0
votes
1answer
5 views

Need to create mapping for a field with numeric and alpha numeric values in elasticsearch

I am trying to create mapping for a field which will need to be used only for exact matches and sorting. I don't want to set primary data type as text as I need to do only exact match. { "...
0
votes
0answers
7 views

writing kibana plugins error to get the data from elasticsearch

has anybody written kibana plugins for elasticsearch? i am stuck on getting data via nodejs client from elasticsearch. My task is to create new visualization in kibana. const adminCluster = server....
0
votes
0answers
14 views

How get top compound words from text in elasticsearch?

I need to get top terms from elasticsearch, currently we are using significant terms functionality provided by elasticsearch but in our case we need multiple words which come frequently and ...
0
votes
0answers
10 views

How to connect BIRT Datasource with Elastic Search?

I am trying to connect a BIRT data source with Elastic Search in eclipse via Elastic Search JDBC client (x-pack-sql-jdbc-7.0.0.jar). Version of my Elastic search server is 7.0 I am able to get the ...
0
votes
0answers
8 views

Parsing Logs Using Elastic Search

I am trying to parse the Cisco ASA logs I am getting but i want specific logs to be parsed, saved and showed on Kibana. I've written a code but its still showing a lot of logs that I do not want. I am ...
0
votes
0answers
12 views

Compare data between Elastic Search and RDS

We are moving our data from RDS to elastic search and the data volume is around 80GB with around 90 million records. We have been using bulk api of elastic search for indexing the data but we want to ...
0
votes
0answers
18 views

How to set ElasticSearch Apm Server indexing template as YYYY.mm?

I just created Apm server it looks awesome but Indexing like that"Apm-6.6.2-2019.04.19" doesn't make sense because I will have at the end of the month 30 logs. I want to use change "apm-%{[beat....
1
vote
0answers
25 views

how to sync data from mongodb to elastic search with python

I am currentlt using Monstache connector for sync MongoDB elastic search. is there any other recommended connector for sync. Architecture: Angular7 Elastic Search Mongo DB Python Pycharm. is there ...
0
votes
0answers
19 views

How to search across multiple indices which have different kinds of documents using Nest ElasticSearch 6.x?

I've got two indices which each have their own kind(different shapes) of document, but I have a requirement where search results should include both of these types of documents. From what I've read ...
0
votes
1answer
17 views

Not getting where data with filter (elastic search 6.4)

elasticsearch version: 6.4 Here is my current data: I want to search for products which has Xbox in name. I am using the match keyword but that is not working. Below is my elastic search query: { ...
0
votes
0answers
13 views

Get child object in FOSElasticaBundle symfony

I want to get child object from my product. Is it fos_elastica.yaml file fos_elastica: clients: default: { host: elasticsearch, port: 9200 } indexes: photos: ...
0
votes
1answer
19 views

Results between two dates in elasticsearch

I'm looking to get data between two dates in elasticsearch. I have tried to put "gte": "20-04-2019" and "lte": "21-04-2019" as shown below, but I still get other anterior dates in the final result: ...
0
votes
0answers
14 views

Elasticsearch: Geo_spacial search in a list of nested objects

I'm using Elasticsearch 6.3 and spring-data-elasticsearch, I have the index restaurant having the mapping below : { "mapping": { "restaurant": { "properties": { "id": { ...
0
votes
0answers
9 views

Can I use matchPhrasePrefixQuery and fuzziness at the same time?

I am using Elasticsearch 6.5 and when I use matchPhrasePrefixQuery it works fine. For Example I have documents like- 1.spiderman is climbing 2.spiderman 3.spider When I type "s" I got all this ...
0
votes
0answers
17 views

using geopoint on elasticsearch from logstsh

I want to use geoip in elk stack from docker. according to this documentation I added config https://www.elastic.co/blog/geoip-in-the-elastic-stack this is my logstash.conf input { beats { ...
0
votes
0answers
20 views

elastic search gives error from doc example

I am trying to learn elasticsearch module in python,(pip3 install elasticsearch) I tried to follow their doc on Python Elasticsearch, here is the code from their site: from datetime import datetime ...
0
votes
0answers
17 views

How to perform many Elasticsearch index operations in a single API call with Scala?

I am injecting data to an index in Elasticsearch. Injecting with POST operations one by one takes a lot of time. I used the Bulk API in Java before, to perform many index operations in a single API ...
0
votes
0answers
13 views

Lucene autocomplete functionality that ignores terms order

I'm trying to implement an AutoComplete feature with lucene based on a filtered set of documents. The difference to all the common auto commlete examples in the web is that only a single term should ...
0
votes
0answers
14 views

Service is injected but results in null pointer exception when its property is used. What can be the probable reason?

I have created a java service/file in src directory of my grails project and I have defined in within the beans in resources.groovy. beans = { elasticsearchConfigManager(...
0
votes
0answers
17 views

Can someone explain routing in elastic-search with an example?

I just started working with elastic-search and I need to use the routing in ES but I don't understand how to use it? I read the routing from elastic-search official references but didn't quite ...
0
votes
0answers
8 views

Neo4j fulltext search with highlights

When using Neo4j full-text search which is based on the Lucene engine. Is there a way to retrieve highlights in the same way as ElasticSearch highlight. Basically, I want to know on which part of the ...
1
vote
1answer
28 views

How to search result must not sum of two values?

How to write a correct query in elasticsearch for: phoneNumber != phoneCode + phone
0
votes
1answer
15 views

logstash: Unknown setting ‘“index”’ for elasticsearch

I'm new to the elastic search concept to make connection with mySQL. I followed multiple tutorials to install but I'm getting these errors: Unknown setting '"index"'and '"host'" for elasticsearch ...
0
votes
0answers
12 views

Elasticsearch query single field with two different analyzers

Instead of using a index multi-field approach, what are the tradeoffs with analyzing a match query twice with different analyzers? For example, a search for "skies" by applying a default english ...
0
votes
0answers
16 views

Elastic search: How to highlight the fragment after the search term?

I am working on a search project which requires the highlight fragment after the search word. My query is { "query": { "multi_match" : { "query" : "prawn", "fields":...
0
votes
0answers
6 views

Using Daily Elastic Indexes can't perform search over more than 3 month back (for preventing Dedup data)

I am using in my system elastic search, and daily indexes my data. The problem i am reading from sources which sometimes gives me dedup information. i try to make a dedup mechanism which check ...
0
votes
0answers
16 views

Recursive not working in kv filter in logstash

I want to know about the use of recursive function in kv filter. I am using a csv file. I uploaded the file to ES using logstash. After reading the guide from this link https://www.elastic.co/guide/...
0
votes
1answer
26 views

Elastic Search Filter on the result of terms aggregation

Apply Match phrase prefix query on the result of terms aggregation in Elastic Search. I have terms query and the result looks something like below "buckets": [ { "key": "KEY", "count": 20 }, { "key":...
0
votes
1answer
16 views

Count the number of document which contains either or both terms, and the term's values must be within a range

I want to count the number of document that has either or both term A and term B if term A or/and term B exist, the value is between a range. I manage to write count for single term count as below ...
1
vote
1answer
27 views

Object mapping for [requestPayload] tried to parse field [requestPayload] as object, but found a concrete value

I am storing a JSON String as Object in elasticsearch but getting Exception below where requestPayload is as our JSON string body: object mapping for [requestPayload] tried to parse field [...
0
votes
2answers
26 views

How to search on Elasticsearch for words with or without apostrophe ? and deal with spelling mistakes?

I'm trying to move my Full Text Search logic from MySQL to Elasticsearch. In MySQL to find all rows containing the word "woman" I would just write SELECT b.code FROM BIBLE b WHERE ((b.DISPLAY_NAME ...
0
votes
1answer
20 views

ElasticSearch: Highlighting with Stemming

I have read this question and attempted to understand the documentation here, but this is complicated. The problem (I think): [update 1] I am using Scala for my code and interface with ES High ...
0
votes
0answers
21 views

Elasticsearch query speed up with repeated used terms query filter

I will need to find out the co-occurrence times between one single tag and another fixed set of tags as whole. I have 10000 different single tags, and there are 10k tags inside fixed set of tags. I ...
0
votes
0answers
13 views

How to build a pipeline from mongodb to elastic-search? [duplicate]

I'm hosting MongoDB as well as elastic search locally so I need to real-time data transfer from MongoDB to elastic-search. I tried composer transporter https://github.com/compose/transporter but it's ...
1
vote
3answers
31 views

How can I send multiple documents to elastic with one API call

I'm new to Elastic and I need a way to push multiple documents to Elastic by only making one call to POST http://localhost:9200/myindex/mytype/. The body schema looks like this: { "docs": [ { "...
0
votes
1answer
19 views

Filter by Score with Ngrams

I have a search string of Resta and currently my results include: "Save at any restaurant!", "Save at any gas station!" The reason is because of my index: { "rewards": { "aliases": {}, "...
2
votes
0answers
17 views

Removing default fields from java elasticsearch querybuilder

Elasticsearch Java client's QueryBuider instance is adding properties like 1) order 2) min_doc_count 3) shard_min_doc_count 4) show_term_doc_count_error 5) lang 6) gap_policy to the final Json query. ...
0
votes
0answers
9 views

Synonyms break alias datatype

When using both alias datatypes and synonyms in an index it seems that the inclusion of the synonyms breaks the functionality of the alias field. To recreate the issue: # Create the index PUT /alias....
0
votes
0answers
11 views

Polygon query in Redisearch

RediSearch looks promising after reading https://redislabs.com/blog/search-benchmarking-redisearch-vs-elasticsearch/. We use elasticsearch currently. We rely heavily on its polygon query feature ...
0
votes
0answers
31 views

Unable to Mock REST API function with Python Mock in Django

I have an API which use ElasticSearch to get data. I have to write test cases for this. These tests will be run using Circle CI. When we run test cases on test cases on Circle CI, test failed as ...
0
votes
0answers
9 views

Best Elastic Search connector For mongodb with phython - Sync MongoDB to Elasticsearch in realtime

I am using Monstache connector for sync mongodb elastic search. is there any other recommended connector for sync. Architecture: Angular7 Elastic Search Mongo DB Phython Pycharm. please provide ...
1
vote
0answers
19 views

Elasticsearch JS: Is there a way to perform highlighting after a query has been executed and hits have been returned?

I have a user-searchable Elasticsearch index whose documents are returned with marked highlighting via Elasticsearch's fast-vector highlighting. Documents in the index have access permissions by ...
1
vote
0answers
19 views

How to delete/update document from AWS ElasticSearch when exact index which consist the document is not known

Background: We have an AWS ElasticSearch with multiple indexes e.g. index-1, index-2. We have an alias "read-alias" associated with both index-1 & index-2. Also we have "write-alias" which is ...
0
votes
1answer
25 views

Error installing Elasticsearch 7 - Failed dependencies

On my dedicated server I currently have Elasticsearch 6 installed. I would like to upgrade to Elasticsearch 7. I'm using the "Download and install the RPM Manually" method. Here's the link that ...
0
votes
1answer
13 views

Is query filtering by a keyword going to perform better than filtering by an integer?

Lets say I have a posts index which holds all the data for all the posts made by every user on a forum, and I wanted to search through the posts made by one particular user, containing the word ...
0
votes
0answers
6 views

ElasticSearch Metricbeat: Filesystem stats not including xfs device

I have an i3.xlarge instance running in AWS and am trying to use Metricbeat to monitor disk usage. I have /dev/nvme0n1 is formatted as xfs. However, Metricbeat will report on /dev/xvda but not /dev/...
1
vote
0answers
23 views

How to integrate ElasticSearch 7.0 version with Spring Boot?

I'm trying to use the latest version of Elastic Search library which is already available in the maven repos. <dependency> <groupId>org.elasticsearch</groupId> <...
0
votes
1answer
14 views

elasticsearch search like “distint count” in sql?

I put the following data in elasticsearch. POST movies/movie { "title": "Apocalypse Now", "director": "Francis Ford Coppola", "year": 1979, "genres": ["Drama", "War", "Foo"] } POST ...

http://mssss.yulina-kosm.ru