class JsonPathLinesParser in Feeds extensible parsers 8
Defines a JSON Lines parser using JSONPath.
Plugin annotation
@FeedsParser(
id = "jsonpathlines",
title = @Translation("JSON Lines JSONPath"),
description = @Translation("Parse JSON Lines with JSONPath.")
)
Hierarchy
- class \Drupal\Component\Plugin\PluginBase implements DerivativeInspectionInterface, PluginInspectionInterface
- class \Drupal\Core\Plugin\PluginBase uses DependencySerializationTrait, MessengerTrait, StringTranslationTrait
- class \Drupal\feeds\Plugin\Type\PluginBase implements FeedsPluginInterface uses DependencyTrait
- class \Drupal\feeds\Feeds\Parser\ParserBase implements MappingPluginFormInterface, ParserInterface
- class \Drupal\feeds_ex\Feeds\Parser\ParserBase implements PluginFormInterface, MappingPluginFormInterface, ParserInterface
- class \Drupal\feeds_ex\Feeds\Parser\JsonParserBase implements ContainerFactoryPluginInterface
- class \Drupal\feeds_ex\Feeds\Parser\JsonPathParser
- class \Drupal\feeds_ex\Feeds\Parser\JsonPathLinesParser
- class \Drupal\feeds_ex\Feeds\Parser\JsonPathParser
- class \Drupal\feeds_ex\Feeds\Parser\JsonParserBase implements ContainerFactoryPluginInterface
- class \Drupal\feeds_ex\Feeds\Parser\ParserBase implements PluginFormInterface, MappingPluginFormInterface, ParserInterface
- class \Drupal\feeds\Feeds\Parser\ParserBase implements MappingPluginFormInterface, ParserInterface
- class \Drupal\feeds\Plugin\Type\PluginBase implements FeedsPluginInterface uses DependencyTrait
- class \Drupal\Core\Plugin\PluginBase uses DependencySerializationTrait, MessengerTrait, StringTranslationTrait
Expanded class hierarchy of JsonPathLinesParser
1 file declares its use of JsonPathLinesParser
- JsonPathLinesParserTest.php in tests/
src/ Unit/ Feeds/ Parser/ JsonPathLinesParserTest.php
File
- src/
Feeds/ Parser/ JsonPathLinesParser.php, line 21
Namespace
Drupal\feeds_ex\Feeds\ParserView source
class JsonPathLinesParser extends JsonPathParser {
/**
* The file iterator.
*
* @var \Drupal\feeds_ex\File\LineIterator
*/
protected $iterator;
/**
* {@inheritdoc}
*/
protected function hasConfigurableContext() {
return FALSE;
}
/**
* {@inheritdoc}
*/
protected function setUp(FeedInterface $feed, FetcherResultInterface $fetcher_result, StateInterface $state) {
$this->iterator = new LineIterator($fetcher_result
->getFilePath());
if (!$this->iterator
->getSize()) {
throw new EmptyFeedException();
}
$this->iterator
->setLineLimit($this->configuration['line_limit']);
if (!$state->total) {
$state->total = $this->iterator
->getSize();
}
$this->iterator
->setStartPosition((int) $state->pointer);
}
/**
* {@inheritdoc}
*/
protected function parseItems(FeedInterface $feed, FetcherResultInterface $fetcher_result, ParserResultInterface $result, StateInterface $state) {
$expressions = $this
->prepareExpressions();
$variable_map = $this
->prepareVariables($expressions);
foreach ($this->iterator as $row) {
$row = $this
->getEncoder()
->convertEncoding($row);
try {
$row = $this->utility
->decodeJsonArray($row);
} catch (RuntimeException $e) {
// An array wasn't returned. Skip this item.
continue;
}
if ($item = $this
->executeSources($row, $expressions, $variable_map)) {
$result
->addItem($item);
}
}
}
/**
* {@inheritdoc}
*/
protected function cleanUp(FeedInterface $feed, ParserResultInterface $result, StateInterface $state) {
$state->pointer = $this->iterator
->ftell();
unset($this->iterator);
parent::cleanUp($feed, $result, $state);
}
/**
* {@inheritdoc}
*/
protected function executeSourceExpression($machine_name, $expression, $row) {
$result = $this
->search($row, $expression);
if (is_scalar($result)) {
return $result;
}
// Return a single value if there's only one value.
return count($result) === 1 ? reset($result) : $result;
}
}
Members
Name | Modifiers | Type | Description | Overrides |
---|---|---|---|---|
DependencySerializationTrait:: |
protected | property | An array of entity type IDs keyed by the property name of their storages. | |
DependencySerializationTrait:: |
protected | property | An array of service IDs keyed by property name used for serialization. | |
DependencySerializationTrait:: |
public | function | 1 | |
DependencySerializationTrait:: |
public | function | 2 | |
DependencyTrait:: |
protected | property | The object's dependencies. | |
DependencyTrait:: |
protected | function | Adds multiple dependencies. | |
DependencyTrait:: |
protected | function | Adds a dependency. | |
JsonParserBase:: |
protected | property | The JSON helper class. | |
JsonParserBase:: |
public static | function |
Creates an instance of the plugin. Overrides ContainerFactoryPluginInterface:: |
|
JsonParserBase:: |
protected | function |
Starts internal error handling. Overrides ParserBase:: |
|
JsonParserBase:: |
public | function |
Constructs a JsonParserBase object. Overrides ParserBase:: |
1 |
JsonPathLinesParser:: |
protected | property | The file iterator. | |
JsonPathLinesParser:: |
protected | function |
Allows subclasses to cleanup after parsing. Overrides JsonPathParser:: |
|
JsonPathLinesParser:: |
protected | function |
Executes a single source expression. Overrides JsonPathParser:: |
|
JsonPathLinesParser:: |
protected | function |
Returns whether or not this parser uses a context query. Overrides ParserBase:: |
|
JsonPathLinesParser:: |
protected | function |
Performs the actual parsing. Overrides ParserBase:: |
|
JsonPathLinesParser:: |
protected | function |
Allows subclasses to prepare for parsing. Overrides ParserBase:: |
|
JsonPathParser:: |
protected | function |
Returns rows to be parsed. Overrides ParserBase:: |
|
JsonPathParser:: |
protected | function |
Returns the errors after parsing. Overrides ParserBase:: |
|
JsonPathParser:: |
protected | function |
Loads the necessary library. Overrides ParserBase:: |
|
JsonPathParser:: |
protected | function | Searches an array via JSONPath. | |
JsonPathParser:: |
protected | function |
Validates an expression. Overrides ParserBase:: |
|
MessengerTrait:: |
protected | property | The messenger. | 29 |
MessengerTrait:: |
public | function | Gets the messenger. | 29 |
MessengerTrait:: |
public | function | Sets the messenger. | |
ParserBase:: |
protected | property | The encoder used to convert encodings. | |
ParserBase:: |
protected | property | The class used as the text encoder. | 1 |
ParserBase:: |
protected | property | The messenger, for compatibility with Drupal 8.5. | |
ParserBase:: |
protected static | property | The default list of HTML tags allowed by Xss::filter(). | |
ParserBase:: |
public | function |
Form constructor. Overrides PluginFormInterface:: |
1 |
ParserBase:: |
public | function | ||
ParserBase:: |
protected | function | Returns a form element for a specific column. | 1 |
ParserBase:: |
protected | function | Returns the list of table headers. | 1 |
ParserBase:: |
public | function | 1 | |
ParserBase:: |
protected | function | Returns the description for single source. | 1 |
ParserBase:: |
protected | function |
Returns the label for single source. Overrides ParserBase:: |
1 |
ParserBase:: |
protected | function | Renders our debug messages into a list. | |
ParserBase:: |
public | function |
Gets default configuration for this plugin. Overrides PluginBase:: |
1 |
ParserBase:: |
protected | function | Executes the source expressions. | |
ParserBase:: |
public | function | Returns the encoder. | |
ParserBase:: |
protected | function | Returns the configuration form table header. | |
ParserBase:: |
public | function |
Declare the possible mapping sources that this parser produces. Overrides ParserInterface:: |
|
ParserBase:: |
public | function | Gets the messenger. | |
ParserBase:: |
public | function | 1 | |
ParserBase:: |
public | function | ||
ParserBase:: |
public | function |
Alter mapping form. Overrides ParserBase:: |
|
ParserBase:: |
public | function |
Submit handler for the mapping form. Overrides ParserBase:: |
|
ParserBase:: |
public | function |
Validate handler for the mapping form. Overrides ParserBase:: |
|
ParserBase:: |
public | function |
Parses content returned by fetcher. Overrides ParserInterface:: |
|
ParserBase:: |
protected | function | Prepares the expressions for parsing. | |
ParserBase:: |
protected | function | Prepares the raw string for parsing. | |
ParserBase:: |
protected | function | Prepares the variable map used to substitution. | |
ParserBase:: |
protected | function | Prints errors to the screen. | |
ParserBase:: |
public | function | Sets the encoder. | |
ParserBase:: |
public | function | Sets the messenger. | |
ParserBase:: |
public | function | ||
ParserBase:: |
public | function | ||
ParserBase:: |
public | function | ||
ParserBase:: |
protected | function | Stops internal error handling. | 1 |
ParserBase:: |
public | function |
Form submission handler. Overrides PluginFormInterface:: |
|
ParserBase:: |
public | function |
Form validation handler. Overrides PluginFormInterface:: |
|
ParserBase:: |
public | function | Builds configuration form for the parser settings. | |
PluginBase:: |
protected | property | Configuration information passed into the plugin. | 1 |
PluginBase:: |
protected | property | The importer this plugin is working for. | |
PluginBase:: |
protected | property | The link generator. | |
PluginBase:: |
protected | property | The plugin implementation definition. | 1 |
PluginBase:: |
protected | property | The plugin_id. | |
PluginBase:: |
protected | property | The url generator. | |
PluginBase:: |
public | function |
Calculates dependencies for the configured plugin. Overrides DependentPluginInterface:: |
2 |
PluginBase:: |
private | function | Returns the service container. | |
PluginBase:: |
public | function |
Returns default feed configuration. Overrides FeedsPluginInterface:: |
3 |
PluginBase:: |
constant | A string which is used to separate base plugin IDs from the derivative ID. | ||
PluginBase:: |
public | function |
Gets the base_plugin_id of the plugin instance. Overrides DerivativeInspectionInterface:: |
|
PluginBase:: |
public | function |
Gets this plugin's configuration. Overrides ConfigurableInterface:: |
|
PluginBase:: |
public | function |
Gets the derivative_id of the plugin instance. Overrides DerivativeInspectionInterface:: |
|
PluginBase:: |
public | function |
Gets the definition of the plugin implementation. Overrides PluginInspectionInterface:: |
3 |
PluginBase:: |
public | function |
Gets the plugin_id of the plugin instance. Overrides PluginInspectionInterface:: |
|
PluginBase:: |
public | function | Determines if the plugin is configurable. | |
PluginBase:: |
protected | function | Renders a link to a route given a route name and its parameters. | |
PluginBase:: |
protected | function | Returns the link generator service. | |
PluginBase:: |
public | function | A feed is being deleted. | 3 |
PluginBase:: |
public | function | A feed is being saved. | |
PluginBase:: |
public | function | The feed type is being deleted. | 1 |
PluginBase:: |
public | function | The feed type is being saved. | 1 |
PluginBase:: |
public | function |
Returns the type of plugin. Overrides FeedsPluginInterface:: |
|
PluginBase:: |
public | function |
Sets the configuration for this plugin instance. Overrides ConfigurableInterface:: |
1 |
PluginBase:: |
protected | function | Generates a URL or path for a specific route based on the given parameters. | |
PluginBase:: |
protected | function | Returns the URL generator service. | |
StringTranslationTrait:: |
protected | property | The string translation service. | 1 |
StringTranslationTrait:: |
protected | function | Formats a string containing a count of items. | |
StringTranslationTrait:: |
protected | function | Returns the number of plurals supported by a given language. | |
StringTranslationTrait:: |
protected | function | Gets the string translation service. | |
StringTranslationTrait:: |
public | function | Sets the string translation service to use. | 2 |
StringTranslationTrait:: |
protected | function | Translates a string to the current language or to a given language. |