Spark: Is apache spark .net compatible with elasticSearch?
I need to obtain data from elasticSearch and I can't find a solution for it. I wanted to know if there is any manual or any way to make an inquiry to elasticsearch
question
JoseTala23
All 2 comments
Yes, can you check this thread: #212, #213? Basically you will need to do something like:
C#
var df = spark.Read
.Format("org.elasticsearch.spark.sql")
.Option("inferSchema", "true")
.Option("es.read.field.as.array.include", "tags")
.Option("es.nodes","myelasticsearchserver:9200")
.Option("es.net.http.auth.user","elastic")
.Option("es.net.http.auth.pass","mypassword")
.Load();
imback82
on 30 Jan 2020
👍2
@JoseTala23 I hope that the suggestion worked out for you. Feel free to reopen the issue if it didn't work.
imback82
on 28 Mar 2020
Was this page helpful?
0 / 5 - 0 ratings
Related issues
jammman
路
9Comments
oefe
路
4Comments
dkjha811
路
5Comments
tylorhl
路
4Comments
fabiogouw
路
9Comments
Most helpful comment
Yes, can you check this thread: #212, #213? Basically you will need to do something like:
C# var df = spark.Read .Format("org.elasticsearch.spark.sql") .Option("inferSchema", "true") .Option("es.read.field.as.array.include", "tags") .Option("es.nodes","myelasticsearchserver:9200") .Option("es.net.http.auth.user","elastic") .Option("es.net.http.auth.pass","mypassword") .Load();