[lucenerdd] save index to hdfs#159
Open
zouzias wants to merge 33 commits into
Open
Conversation
This reverts commit a6da0af.
* Remove unused code (#141) * Revert "Setting version to 0.3.4-SNAPSHOT" This reverts commit 2f1d7be. * README: update to 0.3.3 * README: fix javadoc badge * remove unused param * [sbt] version updates * [conf] allow not_analyzed string fields (#145) * [not-analyzed-fields] do not analyzed fields ending with _notanalyzed * [hotfix] fixes issue 150 * [tests] issue 150 * fix typo * [blockEntityLinkage] drop queryPartColumns
* [linkage] block linker with => Query * [linkage] block linker is Row => Query * remove Query analyzer on methods
e355378 to
4f6f0a1
Compare
* [analyzers] custom analyzer * test return null * [travis] travis_wait 1 min * Revert "[travis] travis_wait 1 min" This reverts commit c79456e. * use lucene examples * custom analyzer return null * fix java reflection * add docs
* [lucene] upgrade to version 8.0.0 * [lucene] remove ngram analyzer * delete ngram analyzer * minor fix * add scaladoc
Contributor
|
@zouzias Do you need any support with this? |
yeikel
reviewed
Apr 8, 2019
Owner
Author
|
Hi @yeikel , if you want to work on the issue feel free to continue the PR. The missing items are:
|
* [issue_163] per field analysis * [sbt] update scalatest to 3.0.7 * [issue_163] fix docs; order of arguments * fixes on ShapeLuceneRDD * [issue_163] fix test * issue_163: minor fix * introduce LuceneRDDParams case class * fix apply in LuceneRDDParams * [issue_163] remove duplicate apply defn * add extra LuceneRDD.apply
[issue_165] throw runtime exception; handle multi-valued fields in DataFrames
* [refactor] configuration loading * [travis] code hygiene
* WIP * fix tests * remove SparkDoc class * make test compile * use GenericRowWithSchema * tests: getDouble score * score is a float * fix casting issue with Seq[String] * tests: LuceneDocToSparkRowpec * tests: LuceneDocToSparkRowpec * more tests * LuceneDocToSparkRowpec: more tests * LuceneDocToSparkRowpec: fix tests * LuceneDocToSparkRow: fix Number type inference * LuceneDocToSparkRowpec: fix tests * implicits: remove StoredField for Numeric types * implicits: revert remove StoredField for Numeric types * fix more tests * fix more tests * [tests] fix LuceneRDDResponse .toDF() * fix multivalued fields * fix score type issue * minor * stored fields for numerics * hotfix: TextField must be stored using StoredField * hotfix: stringToDocument implicit * link issue 179 * fix tests * remove _.toRow() calls * fix compile issue
Contributor
|
Any chance you can resolve the merge conflicts here? |
Owner
Author
Done |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
WIP
Tries to fix #147