You are here

protected function Tokenizer::process in Search API 8

Processes a single string value.

This method is ultimately called for all text by the standard implementation, and does nothing by default.

Parameters

mixed $value: The value to preprocess, as a reference. Can be manipulated directly, nothing has to be returned. Since this can be called for all value types, $value has to remain the same type. The possible types for $value depend on shouldProcess().

Overrides FieldsProcessorPluginBase::process

See also

\Drupal\search_api\Processor\FieldsProcessorPluginBase::shouldProcess()

File

src/Plugin/search_api/processor/Tokenizer.php, line 323

Class

Tokenizer
Splits text into individual words for searching.

Namespace

Drupal\search_api\Plugin\search_api\processor

Code

protected function process(&$value) {
  $this
    ->prepare();
  $value = trim($this
    ->simplifyText($value));
  $min = $this->configuration['minimum_word_size'];
  if ($min > 1) {
    $words = explode(' ', $value);
    foreach ($words as $i => $word) {
      if (mb_strlen($word) < $min) {
        unset($words[$i]);
      }
    }
    $value = implode(' ', $words);
  }
}