Articles in this section

RNI-ES Release Notes

Avatar
Jason Stevens
  • Updated
Follow

Introduction

RNI-Elasticsearch is an Elasticsearch[1] plugin for building fuzzy name retrieval and matching applications for persons, locations, and organizations. The plugin was built with Rosette Name Indexer and supports Elasticsearch.

Important

Due to Elasticsearch version enforcement, this version of the plugin will only work with the same version of Elasticsearch. Contact if you require support for a different version of Elasticsearch.

For a list of third-party components that are used in Basis Technology products, see rlpnc/ ThirdPartyLicenses.txt.

Release 7.13.2.0

July 2021

Includes RNI-RNT 7.34.0.c64.1

New

  • Supports Elasticsearch 7.13.2

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.13.2

Release 7.12.1.0

July 2021

Includes RNI-RNT 7.34.0.c64.1

New

  • Supports Elasticsearch 7.12.1

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.12.1

Release 7.11.2.0

July 2021

Includes RNI-RNT 7.34.0.c64.1

New

  • Supports Elasticsearch 7.11.2

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.11.2

Release 7.10.2.3

September 2021

Includes RNI-RNT version 7.35.1.c65.0

New

  • ARM64 processors are now supported. (RLPNC-5912)

  • The score_if_null option can now be used with nested fields. (RLPNC-5923)

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes

Release 7.10.2.2

June 2021

Includes RNI-RNT 7.34.0.c64.1

Bug Fixes

  • Dynamically-specified parameters are now applied successfully and consistently. Previously, there was a bug where added parameters would not always be applied to a query. (RLPNC-5848, RLPNC-5878)

  • RNI-ES now issues an error message when dynamically-specified parameters have invalid names or values. (RLPNC-5849)

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes

Release 7.10.2.1

May 2021

Includes RNI-RNT 7.34.0.c64.1

New

  • Includes RNI-RNT 7.34.0.c64.1. Refer to the RNI-RNT release notes for a full description of new features.

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes

Release 7.10.2.0

February 2021

Includes RNI-RNT 7.33.2.c63.0

New

  • Supports Elasticsearch 7.10.2 and includes RNI-RNT 7.33.2.c63.0

  • The pairwise match endpoint for address matching now provides detailed information on how the addresses were matched.

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.10.2

Release 7.9.3.0

February 2021

Includes RNI-RNT 7.33.2.c63.0

New

  • Supports Elasticsearch 7.9.3

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.9.3

Release 7.9.2.1

January 2021

New

  • Now including RNI-RNT 7.33.2.c63.0

  • Indexing, querying and rescoring can now be performed between addresses structured with fields or as strings. RNI uses the jpostal library to internally parse address strings. (RLPNC-5523)

  • Added support for window_size_allowance and score_to_rescore_resctriction parameters in address matching. (RLPNC-5537)

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting RNI-RNT 7.33.2.c63.0

Release 7.9.2.0

October 2020

New

  • Supports Elasticsearch 7.9.2

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.9.2

Release 7.8.1.0

January 2021

New

  • Supports Elasticsearch 7.8.1 and includes RNI 7.32.3.c62.2

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.8.1

Release 7.7.1.1

October 2020

New Features

  • Now including RNI-RNT 7.32.3.c62.2

  • Addresses are now supported in the pairwise matching endpoint. Matching can be performed between fielded addresses, unfielded addresses, or a combination of the two.

    • Example:

      curl -XPOST 'localhost:9200/rni_plugin/_pair_match?type=rni_address' -H "Content-Type: application/json" -d '
{
  "dataPair": {
    "data1": {
      "houseNumber": "101",
      "road": "Main st",
      "city": "Cambridge",
      "state": "MA",
      "country": "USA"
    },
    "data2": "101 Main St, Cambridge, Massachusetts, United States of America"
  }
}'
      {
  "score": 0.9,
  "type": "ORIGINAL"
}

Bug Fixes

  • Fixed a bug where nested queries could produce documents with the incorrect score with more complex mappings.

    • Previously: All documents could be incorrectly returned with a score of 0.0

    • Now: Documents are returned with the correct score

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Third-party component updates

No changes other than supporting RNI 7.32.3.c62.2

Release 7.7.1.0

June 2020

New Features

  • Support Elasticsearch 7.7.1 and include RNI 7.31.1.c62.2 [2]

Bug Fixes

  • Fixed a bug where nested queries using the rni_rescorer that did not specify the window_size parameter would cause a NullPointerException (RLPNC-5394)

  • Fixed a bug where the windowSizeAllowance and scoreToRescoreRestriction parameters would not properly restrict the first-pass results being rescored in a nested query (RLPNC-5393)

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Third-party component updates

  • No changes other than supporting Elasticsearch 7.7.1 and RNI 7.31.1.c62.2

Release 7.6.1.1

April 2020

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported

Bug fixes

  • Fixed an issue where the enableDynamicConfigurationEndpoints parameter did not properly disable the appropriate endpoints when set to false (RLPNC-5373)

Third-party component updates

No changes

Release 7.6.1.0

April 2020

New Features

  • Support Elasticsearch 7.6.1

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported

Third-party component updates

No changes other than supporting Elasticsearch 7.6.1

Release 7.5.2.1

March 2020

New Features

  • Support Elasticsearch 7.5.2 and include RNI 7.30.5.c62.2

  • Added a new rescore syntax which must be used when using the score_to_rescore_restriction or window_size_allowance parameters (RLPNC-5263)

  • Added the parameter enableDynamicConfigurationEndpoints to enable endpoints for stopwords, token overrides and parameters (RLPNC-5225)

Known Issues

  • It is necessary to add elasticsearch\plugins\rni\bt_root\rlp\bin\amd64-w64-msvc120\ to PATH when installing on Windows

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported

Bug Fixes

  • Fixed an issue where dynamic parameters were not loaded correctly in clusters with multiple nodes (RLPNC-5226)

  • It is now possible to define parameters for multiple parameter universes in a single session (RLPNC-5261)

Third-party component updates

No changes other than supporting Elasticsearch 7.5.2 and RNI 7.30.5.c62.2

Release 7.4.2.5

November 2020

This version supports Elasticsearch 7.4.2 and RNI 7.32.3.c62.2.

New

  • Indexing, querying and rescoring can now be performed between addresses structured with fields or as strings. RNI uses the jpostal library to internally parse address strings.

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

Third-party component updates

No changes.

Release 7.4.2.4

October 2020

New

  • Now including RNI-RNT 7.32.3.c62.2.

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

Third-party component updates

No changes other than supporting Elasticsearch 7.4.2 and RNI 7.32.3.c62.2.

Release 7.4.2.3

August 2020

New Features

  • Addresses are now supported in the pairwise matching endpoint. Matching can be performed between fielded addresses, unfielded addresses, or a combination of the two.

    • Example:

      curl -XPOST 'localhost:9200/rni_plugin/_pair_match?type=rni_address' -H "Content-Type: application/json" -d '
{
  "dataPair": {
    "data1": {
      "houseNumber": "101",
      "road": "Main st",
      "city": "Cambridge",
      "state": "MA",
      "country": "USA"
    },
    "data2": "101 Main St, Cambridge, Massachusetts, United States of America"
  }
}'
      {
  "score": 0.9,
  "type": "ORIGINAL"
}

Bug Fixes

  • Fixed a bug where nested queries could produce documents with the incorrect score with more complex mappings.

    • Previously: All documents could be incorrectly returned with a score of 0.0

    • Now: Documents are returned with the correct score

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Release 7.4.2.2

June 2020

Bug fixes

  • Fixed a bug where nested queries could produce documents with the incorrect score.

    • Previously: All documents could be incorrectly returned with a score of 0.0

    • Now: Documents are returned with the correct score

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Release 7.4.2.1

March 2020

New Features

  • Support Elasticsearch 7.4.2 and include RNI 7.30.5.c62.2

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

  • Katakana-Latin name matching with the enableSeq2SeqTokenScorer parameter enabled is not currently supported.

Release 7.4.2.0 and Earlier

New Features and Bug Fixes

New Features and Bug Fixes in 7.4.2.0

New Features

  • Support Elasticsearch 7.4.2 and including RNI 7.30.1.c62.0

  • Added endpoints to add and remove stopwords (RLPNC-5008)

  • The Explain API now identifies which indexed name matches the query name (RLPNC-5215)

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

  • Katakana-Latin name matching with the "enableSeq2SeqTokenScorer" parameter enabled is not currently supported

New Features and Bug Fixes in 7.3.2.0

New Features

  • Support Elasticsearch 7.3.2 and including RNI 7.29.1.c61.0

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 7.2.1.0

New Features

  • Support Elasticsearch 7.2.1

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Third-Party Components

For a list of third-party components that are used in Basis Technology products, see rlpnc/ThirdPartyLicenses.txt.

Changes in 7.4.2.0

No changes other than supporting Elasticsearch 7.4.2 and RNI 7.30.1.c62.0

Changes in 7.3.2.0

No changes other than supporting Elasticsearch 7.3.2 and RNI 7.29.1.c61.0

Changes in 7.2.1.0

No changes other than supporting Elasticsearch 7.2.1

Releases 6.x.x.x

Release 6.8.8.1

February 2021

New

  • Now including RNI-RNT 7.33.2.63.0

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

Third-party component updates

  • No changes other than supporting RNI-RNT 7.33.2.63.0

Release 6.8.8.0

April 2020

New

  • Supports Elasticsearch 6.8.8

Known Issues

  • The doc_score, name_score and date_score functions are not currently supported in percolator queries.

Third-party component updates

  • No changes other than supporting Elasticsearch 6.8.8

Release 6.7.2.7

February 2020

New Features

  • Includes RNI 7.30.3.c62.2

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Fixed a bug where some parameters were not properly applied to all queries (RLPNC-5292).

Third-party component updates

  • No changes other than those brought in from RNI 7.30.3.c62.2

Release 6.7.2.6

January 2020

New Features

  • Includes RNI 7.30.2.c62.2

  • Added a new custom rescore query and function score to make better use of Elasticsearch rescore functions. They can be used with the rni_query and rni_function_score parameters, respectively (RLPNC-5177).

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

Third-party component updates

  • No changes other than those brought in from RNI 7.30.2.c62.2.

Release 6.7.2.5

October 2019

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Implemented a fix restoring performance to levels observed in RNI-ES plugins compatible with Elasticsearch 5.6.3 (RLPNC-5207)

Release 6.7.2.4

October 2019

Known Issues

  • The doc_score, name_score, and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Implemented a fix to only instantiate CachedScorers once per query name (RLPNC-5181)

6.7.2.3 and earlier New Features and Bug Fixes

New Features and Bug Fixes in 6.7.2.3

New Features

  • Includes RNI 7.29.0.c61.0

  • Added support for the null_value parameter, allowing nulls to be indexed and searched (RLPNC-5076).

  • NameScoreFunction no longer sorts results (RLPNC-5132).

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.7.2.2

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Implemented a fix to correctly retrieve results for a rescore query after restarting an Elasticsearch instance. (RLPNC-5124)

New Features and Bug Fixes in 6.7.2.1

New Features

  • Supporting Elasticsearch 6.7.2 and including RNI 7.28.1.c61.0.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Fixed the redundant reading of RNI config file. Added the parameter "IgnoreBadData", which can be found in bt_root/rlpnc/data/etc/parameter_profiles.yaml file. The "ignoreBadData" parameter can be used to index unsupported language names.

New Features and Bug Fixes in 6.7.2.0

New Features

  • Supporting Elasticsearch 6.7.2.

  • Added endpoints to add, update and delete parameter universes and token overrides. (RLPNC-4929, RLPNC-4987)

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Fixed the date score function to be used with a valid RNI License only. (RLPNC-5019)

New Features and Bug Fixes in 6.7.1.0

New Features

  • Supporting Elasticsearch 6.7.1.

  • Added a new config parameter "ignoreMalformed" which allows the RNI plugin to index documents with unsupported languages but search capabilities are still limited to supported languages. (RLPNC-5001)

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Updated the pairwise match endpoint to include all match result tuple information for name matching. (RLPNC-5063)

  • Addressed an assertion statement in a score function which overlooked some edge cases and sometimes failed. (RLPNC-5050)

New Features and Bug Fixes in 6.6.2.1

New Features

  • Supporting Elasticsearch 6.6.2 and including RNI 7.27.1.c60.0.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.6.2.0

New Features

  • Supporting Elasticsearch 6.6.2 and including RNI 7.26.1.c60.0.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.6.0.0

New Features

  • Added English address matching. (RLPNC-4352, RLPNC-4353, RLPNC-4999)

  • Supporting Elasticsearch 6.6.0 and including RNI 7.26.1.c60.0.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.5.1.0

New Features

  • No changes other than supporting Elasticsearch 6.5.1 and including RNI 7.25.0.c60.0.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.4.2.0

New Features

  • Supports Elasticsearch 6.4.2 and includes RNI 7.24.2.c59.3.

  • Improved documentation on override mechanism. (RLPNC-4866)

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.3.2.0

New Features

  • Supports Elasticsearch 6.3.2 and includes RNI 7.24.0.c59.3.

  • Added pairwise match endpoint for all our supported field types. (RLPNC-4777, RLPNC-4806, RLPNC-4807, RLPNC-4837)

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Fixed a bug that forced object initialization within the plugin to look for RNI-RNT installation. (RLPNC-4852)

  • Fixed a bug where DocScoreFunction explanation returned invalid json if using score_if_null. (RLPNC-4881)

New Features and Bug Fixes in 6.2.4.0

No changes other than supporting Elasticsearch 6.2.4 and including RNI 7.23.3.c59.2.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.2.3.1

No changes other than supporting Elasticsearch 6.2.3 and including RNI 7.23.1.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.2.3.0

No changes other than supporting Elasticsearch 6.2.3 and including RNI 7.23.0.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

Bug Fixes

  • Removed the log4j properties file so that it doesn't override any existing log4j configuration. (RLPNC-4709)

New Features and Bug Fixes in 6.2.2.1

No changes other than supporting Elasticsearch 6.2.2 and including RNI 7.21.1.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.2.2.0

No changes other than supporting Elasticsearch 6.2.2 and including RNI 7.21.0.

Known Issues

  • The doc_score, name_score and date_score functions currently are not supported in percolator queries.

New Features and Bug Fixes in 6.1.1.0

No changes other than supporting Elasticsearch 6.1.1

Known Issues

  • The doc_score function currently is not supported in percolator queries.

Release 6.7.2.3 and Earlier Third-Party Components

Changes in 6.7.2.3

No changes other than those brought in from RNI 7.29.0.c61.0

Changes in 6.7.2.2

No changes.

Changes in 6.7.2.1

No changes other than those brought in from RNI 7.28.1.c61.0.

Changes in 6.7.2.0

Supporting Elasticsearch 6.7.2 and changes brought in from RNI 7.28.0.c61.0.

Added:

  • Elasticsearch Rest Client 6.7.2 (Apache License)

  • Elasticsearch Rest High Level Client 6.7.2 (Apache License)

Changes in 6.7.1.0

No changes other than supporting Elasticsearch 6.7.1.

Changes in 6.6.2.1

No changes other than supporting Elasticsearch 6.6.2 and those brought in from RNI 7.27.1.c60.0.

Changes in 6.6.2.0

No changes other than supporting Elasticsearch 6.6.2 and those brought in from RNI 7.26.1.c60.0.

Changes in 6.6.0.0

No changes other than supporting Elasticsearch 6.6.0 and those brought in from RNI 7.26.1.c60.0.

Changes in 6.5.1.0

No changes other than supporting Elasticsearch 6.5.1 and those brought in from RNI 7.25.0.c60.0.

Changes in 6.4.2.0

No changes other than supporting Elasticsearch 6.4.2 and those brought in from RNI 7.24.2.c59.3.

Changes in 6.3.2.0

No changes other than supporting Elasticsearch 6.3.2 and those brought in from RNI 7.24.0.c59.3.

Changes in 6.2.4.0

No changes other than supporting Elasticsearch 6.2.4 and those brought in from RNI 7.23.3.c59.2.

Changes in 6.2.3.1

No changes other than supporting Elasticsearch 6.2.3 and those brought in from RNI 7.23.1.

Changes in 6.2.3.0

No changes other than supporting Elasticsearch 6.2.3 and those brought in from RNI 7.23.0.

Changes in 6.2.2.1

No changes

Changes in 6.2.2.0

No changes

Changes in 6.1.1.0

No Changes

Releases 5.x.x.x and Earlier

New Features and Bug Fixes

New Features and Bug Fixes in 5.6.3.2

No changes other than including RNI 7.21.1.

New Features and Bug Fixes in 5.6.3.1

New Features

  • Added a new Thai/English statistical model for matching to improve Thai/English name match performance. (RLPNC-4429)

  • Added a new Thai name segmentation dictionary, improving segmentation and match performance. (RLPNC-4421)

  • Improved Thai transliteration, benefiting translation and match performance. (RLPNC-4547)

  • Enhanced the Thai stop word list, providing better stop word removal from Thai names during matching. (RLPNC-4461)

  • Tuned the finalBias value for Thai/Thai and Thai/English name pairs to ensure scores for these matches are in line with those of other languages supported by RNI. (RLPNC-4445)

  • Greatly improved Arabic/Arabic match performance by adding an edit distance metric. (RLPNC-4508)

  • Improved match performance for name pairs in which the names are identical when spaces are removed. (RLPNC-4495)

  • Added a few new entries to English/English token overrides. (RLPNC-4529)

  • Modified the names of RNI's internal Lucene fields so that they are simpler and standardized. (RLPNC-2506)

  • Added the ability to disable support for individual languages. See internal_param_defs.yaml in rlpnc/data/etc for more information on how to use this feature. (RLPNC-4558)

Known Issues

  • While we have fixed a bug involving nested fields and the doc_score function, due to limitations of Elasticsearch, one still cannot rescore nested text fields with the doc_score function. If you desire to rescore nested text fields, you must set the fields to be stored in your mapping.

  • The name_score, date_score, and doc_score functions currently are not supported in percolator queries. Percolator queries that utilize rni_name or rni_date fields will work, however.

New Features and Bug Fixes in 5.6.3.0

New Features

  • Added preview support for Thai in name matching and name translation. (RLPNC-4444, RLPNC-4420, RLPNC-4419, RLPNC-4417, RLPNC-4490, RLPNC-4424, RLPNC-4423, RLPNC-4493, RLPNC-4479, RLPNC-4418)

  • Changed default behavior of Chinese names during Chinese / English matching so that they are assumed to be of Chinese origin unless otherwise specified. (RLPNC-4375)

  • Improved Russian / English name matching in that Russian names now include multiple translations. (RLPNC-4496)

  • Greatly improved Chinese / Japanese organization name language detection. (RLPNC-4477)

  • Improved name matching to account for more substring matches. (RLPNC-4498)

  • Changed the way rni_name and rni_date fields are constructed so that they may now take null as a value. (RLPNC-4485)

Bug Fixes

  • Fixed a bug in which nested fields could not be used in the doc_score function. See the Known Issues section below for more details. (RLPNC-4500)

  • Fixed a bug in which the doc_score function would crash if a field was specified that was not present in the mapping. (RLPNC-4499)

  • Fixed a thread contention issue that could slow down large numbers of threads.

Known Issues

  • While we have fixed a bug involving nested fields and the doc_score function, due to limitations of Elasticsearch, one still cannot rescore nested text fields with the doc_score function. If you desire to rescore nested text fields, you must set the fields to be stored in your mapping.

  • The name_score, date_score, and doc_score functions currently are not supported in percolator queries. Percolator queries that utilize rni_name or rni_date fields will work, however.

New Features and Bug Fixes in 5.5.1.0

New Features

  • Upgraded the native libraries of the native Linux-compatible release of RNI. We are now using CentOS 6 to build these libraries, as CentOS 5 has reached EOL. The new BT_BUILD value for the Linux package is amd64-glibc212-gcc44. (RLPNC-4278)

  • Added a new config parameter, engEngFastMode which improves speed for English-English matching by turning off HMM and simplifying queries. For more information, check the documentation in internal_param_defs.yaml. (RLPNC-4357)

  • Added static and deprecated attributes for config parameters. A "static" parameter is one that always has the value loaded in the default parameter profile; setting a static parameter to a different value in other profiles has no effect whatsoever. A "deprecated" parameter is one that we are proposing to eliminate; binding its value to anything other than the default results in a warning. (RLPNC-4193)

  • Improved the efficiency of when the HMM is used in the case of English-English name pairs. (RLPNC-2988)

Bug Fixes

  • Fixed a bug preventing nested rni_date fields from being queryable. (RLPNC-4465)

Known Issues

  • The name_score, date_score, and doc_score functions currently are not supported in percolator queries. Percolator queries that utilize rni_name or rni_date fields will work, however.

New Features and Bug Fixes in 5.4.1.0

No changes other than supporting Elasticsearch 5.4.1

Known Issues

  • The embedded version of Lucene (6.5.1) in Elasticsearch 5.4.1 contains a bug that affects nested queries with ScoreMode set to MAX. For this reason, we recommend not using these types of nested queries in any version of the plugin compatible with Elasticsearch 5.4.1. This bug has been fixed in a future version of Lucene and should no longer be an issue in future Elasticsearch versions. (

    LUCENE-7833

    )

New Features and Bug Fixes in 5.3.2.0

No changes other than supporting Elasticsearch 5.3.2

New Features and Bug Fixes in 5.3.1.0

No changes other than supporting Elasticsearch 5.3.1

New Features and Bug Fixes in 5.2.2.0

New Features

  • Added the ability to choose a score to be returned for a null field in the doc-level score function. (RLPNC-4296)

Bug Fixes

    New Features and Bug Fixes in 5.0.2.2

    New Features

    • Added detailed match information in the explain output for the doc-level score function. (RLPNC-4256)

    Bug Fixes

    • Fixed an issue that caused errors when the plugin attempted to use word embeddings. (RLPNC-4295)

    New Features and Bug Fixes in 5.0.2.1

    New Features

    • Explain information for rni_date and rni_name fields now includes more detailed match information. (RLPNC-3930, RLPNC-4255)

    • Reduced the size of the package through the word embeddings datafiles. (RLPNC-4245)

    Bug Fixes

    • Fixed an issue that caused errors when trying to load an index containing rni_name fields in Kibana. (RLPNC-4260)

    New Features and Bug Fixes in 5.0.2.0

    New Features

    • Added a new doc-level score function, which allows for scoring across all fields in a document. (RLPNC-4152, RLPNC-4153, RLPNC-4177)

    • Added new API methods for scoring names and dates. (RLPNC-4139)

    • Removed the minScoreToCheck parameter for the name score function. (RLPNC-4189)

    • Made Date scoring classes and methods public for API use. (RLPNC-4218)

    • Enhanced semantic matching of tokens in Organization names through use of word embeddings.

      Note: This drastically increases the size of the plugin package. To reduce the size, the embeddings dictionaries in plugins/rni/bt_root/rlpnc/data/tvec/multilingual can be removed as long as the corresponding language pairs in parameter_profiles.yaml have 'useEmbedded' set to false. (RLPNC-4173, RLPNC-4201, RLPNC-4219, RLPNC-4244)

    Bug Fixes

      New Features and Bug Fixes in 2.4.1.1

      Bug Fixes

      • Fixed an issue where some documents would fail to be rescored when using query parameters (minScoreToCheck, windowSizeAllowance, and scoreToRescoreRestriction). (RLPNC-4195)

      New Features and Bug Fixes in 2.4.1.0

      New Features

      • Added a new query parameter, windowSizeAllowance, which sets the general proportion of names to pass to the rescorer. This is used at query time to determine the number of names to rescore based on the commonality of the query name in the index, allowing for more efficient querying. As a result, generally a higher window size can be used. (RLPNC-4151)

      • Added a new query parameter, scoreToRescoreRestriction, that acts as a more efficient replacement for minScoreToCheck and improves query speed. The minScoreToCheck parameter has been deprecated. (RLPNC-4165)

      • Removed the requirement for an installed bt_root for client-side Java code that communicates with the Elasticsearch server via the Java API. (RLPNC-4131)

      Bug Fixes

      • Fixed a failure that occurred when querying for a field that is not in some documents with minScoreToCheck above 0. (RLPNC-4087)

      • Fixed an issue where a query size of 0 or unspecified prevented aggregations from being returned. (RLPNC-4188)

      New Features and Bug Fixes in 2.3.4.0

      New Features

      • Implemented experimental support for fuzzy date search. (RLPNC-3991, RLPNC-3992)

      • is now released separately from . Versioning has changed to align with the version of Elasticsearch that is supported. (RLPNC-4048)

      • Added ability to retrieve the version of being used by the plugin. (RLPNC-4040)

      • rni_name fields themselves can no longer be nested objects. To retain nested behavior they must be contained in a nested object. (RLPNC-4065)

      Bug Fixes

      • Fixed a permission issue that prevented the plugin from loading native libraries. (RLPNC-4043)

      • Using rni_name fields within a nested object no longer causes a MapperParsingException. (RLPNC-4056)

      • Calling _verify_installation will now function when the Elasticsearch server is using an HTTP port other than the default (9200). (RLPNC-4082)

      • Fixed a crash that occurred when querying for a field that does not exist in some documents (RLPNC-4087)

      For information on previous work done on RNI-Elasticsearch, see the release notes for (versions 7.14.0 and previous).

      Third-Party Components

      For a list of third-party components that are used in Basis Technology products, see rlpnc/ThirdPartyLicenses.txt.

      Changes in 5.6.3.2

      No changes other than those brought in from RNI 7.21.1.

      Changes in 5.6.3.1

      Updated:

      • MongoDB Java Driver 3.5.0 (Apache License) from 3.4.2

      Changes in 5.6.3.0

      Added:

      • MongoDB Java Driver 3.4.2 (Apache License)

      Updated:

      • Apache Log4j Core 2.9.1 (Apache License) from 2.8.2

      • International Components for Unicode (ICU) ICU4J 59.1 (ICU License) from 55.1

      Deleted:

      • Joda time 2.9.3 (Apache License)

      Changes in 5.5.1.0

      No Changes

      Changes in 5.4.1.0

      Updated:

      • Apache Log4j Core 2.8.2 (Apache License) from 2.7

      Changes in 5.3.2.0

      No Changes

      Changes in 5.3.1.0

      No Changes

      Changes in 5.2.2.0

      Updated:

      • Apache Log4j Core 2.7 (Apache License) from 2.6.2

      Changes in 5.0.2.2

      No Changes

      Changes in 5.0.2.1

      No Changes

      Changes in 5.0.2.0

      Added:

      • Apache Log4j Core 2.6.2 (Apache License)

      • Elasticsearch Transport Client 5.0.2 (Apache License)

      Updated:

      • Apache Lucene Core 6.2.1 (Apache License) from 6.0.1

      • Jackson Annotations 2.8.1 (Apache License) from 2.7.3

      • Jackson Core 2.8.1 (Apache License) from 2.7.3

      • Jackson Databind 2.8.1 (Apache License) from 2.7.3

      • Jackson Dataformat YAML 2.8.1 (Apache License) from 2.7.3

      • fastutil 6.6.1 (Apache License) from 6.6.0

      • slf4j 1.7.21 (MIT) from 1.6.3

      Changes in 2.3.4.0

      Added:

      • Joda time 2.9.3 (Apache License)

      Updated:

      • Apache Lucene Core 6.0.1 (Apache License) from 5.2.1

      • Jackson Annotations 2.7.3 (Apache License) from 2.6.2

      • Jackson Core 2.7.3 (Apache License) from 2.6.2

      • Jackson Databind 2.7.3 (Apache License) from 2.6.2

      • Jackson Dataformat YAML 2.7.3 (Apache License) from 2.6.2

      Related articles

      Comments

      2 comments

      Sort by Date Votes
      • Avatar
        Jason Stevens

        Dear Users,

        This notification is to alert you that RNI-Elasticsearch plugin version 7.10.2.1 is now available for distribution to clients with active maintenance agreements. If you would like to be provided a shipment email with links to the this version please open a support ticket via  http://support.rosette.com .

         

        Rosette Support Team

         

        You are receiving this automated notification as this email has subscribed to the release notes section in the Rosette knowledge-base.  If you wish to unsubscribe from future notifications you can modify your subscription via the follow/unfollow button in the section that contains the linked article this notification is concerning.  Please note we are not able to add followers or remove followers form this listing as this is a self subscribing notification system.

        0
        Comment actions Permalink
      • Avatar
        Jason Stevens

        Dear Users,

        This notification is to alert you that RNI-Elasticsearch plugin versions 7.11.2.0 and 7.13.2.0 are now available for distribution to clients with active maintenance agreements. If you would like to be provided a shipment email with links to the this version please open a support ticket via  http://support.rosette.com .

         

        Rosette Support Team

         

        You are receiving this automated notification as this email has subscribed to the release notes section in the Rosette knowledge-base.  If you wish to unsubscribe from future notifications you can modify your subscription via the follow/unfollow button in the section that contains the linked article this notification is concerning.  Please note we are not able to add followers or remove followers form this listing as this is a self subscribing notification system.

        0
        Comment actions Permalink

      Please sign in to leave a comment.





      Powered by Zendesk