You are here

README.txt in Feeds 7

Same filename and directory in other branches
  1. 8.3 README.txt
  2. 8.2 README.txt
  3. 6 README.txt
  4. 7.2 README.txt

"It feeds"


FEEDS
=====

An import and aggregation framework for Drupal.
http://drupal.org/project/feeds

Features
========

- Pluggable import configurations consisting of fetchers (get data) parsers
  (read and transform data) and processors (create content on Drupal).
-- HTTP upload (with optional PubSubHubbub support).
-- File upload.
-- CSV, RSS, Atom parsing.
-- Creates nodes or terms.
-- Creates lightweight database records if Data module is installed.
   http://drupal.org/project/data
-- Additional fetchers/parsers or processors can be added by an object oriented
   plugin system.
-- Granular mapping of parsed data to content elements.
- Import configurations can be piggy backed on nodes (thus using nodes to track
  subscriptions to feeds) or they can be used on a standalone form.
- Unlimited number of import configurations.
- Export import configurations to code.
- Optional libraries module support.

Requirements
============

- CTools 1.x
  http://drupal.org/project/ctools
- Job Scheduler
  http://drupal.org/project/job_scheduler
- Drupal 7.x
  http://drupal.org/project/drupal
- PHP safe mode is not supported, depending on your Feeds Importer configuration
  safe mode may cause no problems though.

Installation
============

- Install Feeds, Feeds Admin UI.
- To get started quick, install one or all of the following Feature modules:
  Feeds News, Feeds Import, Feeds Fast News (more info below).
- Make sure cron is correctly configured http://drupal.org/cron
- Go to import/ to import data.
- To use SimplePie parser, download SimplePie and place simplepie.inc into
  feeds/libraries. Recommended version: 1.2.
  http://simplepie.org/

Feature modules
===============

Feeds ships with three feature modules that can be enabled on
admin/build/modules or - if you are using Features - on admin/build/features.
http://drupal.org/project/features

The purpose of these modules is to provide a quick start for using Feeds. You
can either use them out of the box as they come or you can take them as samples
to learn how to build import or aggregation functionality with Feeds.

The feature modules merely contain sets of configurations using Feeds and in
some cases the modules Node, Views or Data. If the default configurations do not
fit your use case you can change them on the respective configuration pages for
Feeds, Node, Views or Data.

Here is a description of the provided feature modules:

- Feeds News -

This feature is a news aggregator. It provides a content type "Feed" that can
be used to subscribe to RSS or Atom feeds. Every item on such a feed is
aggregated as a node of the type "Feed item", also provided by the module.

What's neat about Feeds News is that it comes with a configured View that shows
a list of news items with every feed on the feed node's "View items" tab. It
also comes with an OPML importer filter that can be accessed under /import.

- Feeds Fast News -

This feature is very similar to Feeds News. The big difference is that instead
of aggregating a node for every item on a feed, it creates a database record
in a single table, thus significantly improving performance. This approach
especially starts to save resources when many items are being aggregated and
expired (= deleted) on a site.

- Feeds Import -

This feature is an example illustrating Feeds' import capabilities. It contains
a node importer and a user importer that can be accessed under /import. Both
accept CSV or TSV files as imports.

PubSubHubbub support
====================

Feeds supports the PubSubHubbub publish/subscribe protocol. Follow these steps
to set it up for your site.
http://code.google.com/p/pubsubhubbub/

- Go to admin/build/feeds and edit (override) the importer configuration you
  would like to use for PubSubHubbub.
- Choose the HTTP Fetcher if it is not already selected.
- On the HTTP Fetcher, click on 'settings' and check "Use PubSubHubbub".
- Optionally you can use a designated hub such as http://superfeedr.com/ or your
  own. If a designated hub is specified, every feed on this importer
  configuration will be subscribed to this hub, no matter what the feed itself
  specifies.

Libraries support
=================

If you are using Libraries module, you can place external libraries in the
Libraries module's search path (for instance sites/all/libraries. The only
external library used at the moment is SimplePie.

Libraries found in the libraries search path are preferred over libraries in
feeds/libraries/.

Transliteration support
=======================

If you plan to store files with Feeds - for instance when storing podcasts
or images from syndication feeds - it is recommended to enable the
Transliteration module to avoid issues with non-ASCII characters in file names.
http://drupal.org/project/transliteration

API Overview
============

See "The developer's guide to Feeds":
http://drupal.org/node/622700

Testing
=======

See "The developer's guide to Feeds":
http://drupal.org/node/622700

Debugging
=========

Set the Drupal variable 'feeds_debug' to TRUE (i. e. using drush). This will
create a file /tmp/feeds_[my_site_location].log. Use "tail -f" on the command
line to get a live view of debug output.

Note: at the moment, only PubSubHubbub related actions are logged.

Performance
===========

See "The site builder's guide to Feeds":
http://drupal.org/node/622698

Hidden settings
===============

Hidden settings are variables that you can define by adding them to the $conf
array in your settings.php file.

Name:        feeds_debug
Default:     FALSE
Description: Set to TRUE for enabling debug output to
             /DRUPALTMPDIR/feeds_[sitename].log

Name:        feeds_importer_class
Default:     'FeedsImporter'
Description: The class to use for importing feeds.

Name:        feeds_source_class
Default:     'FeedsSource'
Description: The class to use for handling feed sources.

Name:        feeds_worker_time
Default:     15
Description: Execution time for a queue worker, only effective if used with
             drupal_queue.

Name:        feeds_data_$importer_id
Default:     feeds_data_$importer_id
Description: The table used by FeedsDataProcessor to store feed items. Usually a
             FeedsDataProcessor builds a table name from a prefix (feeds_data_)
             and the importer's id ($importer_id). This default table name can
             be overridden by defining a variable with the same name.

Name:        feeds_node_batch_size
Default:     50
             The number of nodes feed node processor creates or deletes in one
             page load.

Name:        http_request_timeout
Default:     15
Description: Timeout in seconds to wait for an HTTP get request to finish.

Glossary
========

See "Feeds glossary":
http://drupal.org/node/622710

File

README.txt
View source
  1. "It feeds"
  2. FEEDS
  3. =====
  4. An import and aggregation framework for Drupal.
  5. http://drupal.org/project/feeds
  6. Features
  7. ========
  8. - Pluggable import configurations consisting of fetchers (get data) parsers
  9. (read and transform data) and processors (create content on Drupal).
  10. -- HTTP upload (with optional PubSubHubbub support).
  11. -- File upload.
  12. -- CSV, RSS, Atom parsing.
  13. -- Creates nodes or terms.
  14. -- Creates lightweight database records if Data module is installed.
  15. http://drupal.org/project/data
  16. -- Additional fetchers/parsers or processors can be added by an object oriented
  17. plugin system.
  18. -- Granular mapping of parsed data to content elements.
  19. - Import configurations can be piggy backed on nodes (thus using nodes to track
  20. subscriptions to feeds) or they can be used on a standalone form.
  21. - Unlimited number of import configurations.
  22. - Export import configurations to code.
  23. - Optional libraries module support.
  24. Requirements
  25. ============
  26. - CTools 1.x
  27. http://drupal.org/project/ctools
  28. - Job Scheduler
  29. http://drupal.org/project/job_scheduler
  30. - Drupal 7.x
  31. http://drupal.org/project/drupal
  32. - PHP safe mode is not supported, depending on your Feeds Importer configuration
  33. safe mode may cause no problems though.
  34. Installation
  35. ============
  36. - Install Feeds, Feeds Admin UI.
  37. - To get started quick, install one or all of the following Feature modules:
  38. Feeds News, Feeds Import, Feeds Fast News (more info below).
  39. - Make sure cron is correctly configured http://drupal.org/cron
  40. - Go to import/ to import data.
  41. - To use SimplePie parser, download SimplePie and place simplepie.inc into
  42. feeds/libraries. Recommended version: 1.2.
  43. http://simplepie.org/
  44. Feature modules
  45. ===============
  46. Feeds ships with three feature modules that can be enabled on
  47. admin/build/modules or - if you are using Features - on admin/build/features.
  48. http://drupal.org/project/features
  49. The purpose of these modules is to provide a quick start for using Feeds. You
  50. can either use them out of the box as they come or you can take them as samples
  51. to learn how to build import or aggregation functionality with Feeds.
  52. The feature modules merely contain sets of configurations using Feeds and in
  53. some cases the modules Node, Views or Data. If the default configurations do not
  54. fit your use case you can change them on the respective configuration pages for
  55. Feeds, Node, Views or Data.
  56. Here is a description of the provided feature modules:
  57. - Feeds News -
  58. This feature is a news aggregator. It provides a content type "Feed" that can
  59. be used to subscribe to RSS or Atom feeds. Every item on such a feed is
  60. aggregated as a node of the type "Feed item", also provided by the module.
  61. What's neat about Feeds News is that it comes with a configured View that shows
  62. a list of news items with every feed on the feed node's "View items" tab. It
  63. also comes with an OPML importer filter that can be accessed under /import.
  64. - Feeds Fast News -
  65. This feature is very similar to Feeds News. The big difference is that instead
  66. of aggregating a node for every item on a feed, it creates a database record
  67. in a single table, thus significantly improving performance. This approach
  68. especially starts to save resources when many items are being aggregated and
  69. expired (= deleted) on a site.
  70. - Feeds Import -
  71. This feature is an example illustrating Feeds' import capabilities. It contains
  72. a node importer and a user importer that can be accessed under /import. Both
  73. accept CSV or TSV files as imports.
  74. PubSubHubbub support
  75. ====================
  76. Feeds supports the PubSubHubbub publish/subscribe protocol. Follow these steps
  77. to set it up for your site.
  78. http://code.google.com/p/pubsubhubbub/
  79. - Go to admin/build/feeds and edit (override) the importer configuration you
  80. would like to use for PubSubHubbub.
  81. - Choose the HTTP Fetcher if it is not already selected.
  82. - On the HTTP Fetcher, click on 'settings' and check "Use PubSubHubbub".
  83. - Optionally you can use a designated hub such as http://superfeedr.com/ or your
  84. own. If a designated hub is specified, every feed on this importer
  85. configuration will be subscribed to this hub, no matter what the feed itself
  86. specifies.
  87. Libraries support
  88. =================
  89. If you are using Libraries module, you can place external libraries in the
  90. Libraries module's search path (for instance sites/all/libraries. The only
  91. external library used at the moment is SimplePie.
  92. Libraries found in the libraries search path are preferred over libraries in
  93. feeds/libraries/.
  94. Transliteration support
  95. =======================
  96. If you plan to store files with Feeds - for instance when storing podcasts
  97. or images from syndication feeds - it is recommended to enable the
  98. Transliteration module to avoid issues with non-ASCII characters in file names.
  99. http://drupal.org/project/transliteration
  100. API Overview
  101. ============
  102. See "The developer's guide to Feeds":
  103. http://drupal.org/node/622700
  104. Testing
  105. =======
  106. See "The developer's guide to Feeds":
  107. http://drupal.org/node/622700
  108. Debugging
  109. =========
  110. Set the Drupal variable 'feeds_debug' to TRUE (i. e. using drush). This will
  111. create a file /tmp/feeds_[my_site_location].log. Use "tail -f" on the command
  112. line to get a live view of debug output.
  113. Note: at the moment, only PubSubHubbub related actions are logged.
  114. Performance
  115. ===========
  116. See "The site builder's guide to Feeds":
  117. http://drupal.org/node/622698
  118. Hidden settings
  119. ===============
  120. Hidden settings are variables that you can define by adding them to the $conf
  121. array in your settings.php file.
  122. Name: feeds_debug
  123. Default: FALSE
  124. Description: Set to TRUE for enabling debug output to
  125. /DRUPALTMPDIR/feeds_[sitename].log
  126. Name: feeds_importer_class
  127. Default: 'FeedsImporter'
  128. Description: The class to use for importing feeds.
  129. Name: feeds_source_class
  130. Default: 'FeedsSource'
  131. Description: The class to use for handling feed sources.
  132. Name: feeds_worker_time
  133. Default: 15
  134. Description: Execution time for a queue worker, only effective if used with
  135. drupal_queue.
  136. Name: feeds_data_$importer_id
  137. Default: feeds_data_$importer_id
  138. Description: The table used by FeedsDataProcessor to store feed items. Usually a
  139. FeedsDataProcessor builds a table name from a prefix (feeds_data_)
  140. and the importer's id ($importer_id). This default table name can
  141. be overridden by defining a variable with the same name.
  142. Name: feeds_node_batch_size
  143. Default: 50
  144. The number of nodes feed node processor creates or deletes in one
  145. page load.
  146. Name: http_request_timeout
  147. Default: 15
  148. Description: Timeout in seconds to wait for an HTTP get request to finish.
  149. Glossary
  150. ========
  151. See "Feeds glossary":
  152. http://drupal.org/node/622710