Documentation

Author: JanPetterMG

docs/README.md

@@ -6,14 +6,14 @@
 
 ## Create an `robots.txt` parser instance
 You have 3 different ways to construct the `robots.txt` parser, each suited for different demands.
-### Automatic download
+### - Automatic download
 ```php
 $client = new \vipnytt\RobotsTxtParser\UriClient('http://example.com');
 ```
 - [Documentation + additional UriClient specific methods](methods/UriClient.md).
 - [Usage examples](#uriclient)
 
-### Custom `robots.txt` input
+### - Custom `robots.txt` input
 ```php
 $robotsTxt = "
 User-agent: *
@@ -26,7 +26,7 @@ $client = new \vipnytt\RobotsTxtParser\TxtClient('http://example.com', 200, $rob
 - [Documentation](methods/TxtClient.md).
 - [Usage examples](#txtclient)
 
-### The integrated caching system
+### - The integrated caching system
 ```php
 $pdo = new PDO('mysql:host=127.0.0.1;dbname=database', 'username', 'password');
 $handler = new \vipnytt\RobotsTxtParser\Cache($pdo);
@@ -39,6 +39,7 @@ $client = $handler->client('http://example.com');
 ## The Delay handler
 The Delay class is mainly for administration purposes, but may also be used as an alternative way to handle delays. It is generally not needed, but available usage examples are shown below.
 ```php
+$pdo = new PDO('mysql:host=127.0.0.1;dbname=database', 'username', 'password');
 $delayHandler = new \vipnytt\RobotsTxtParser\Delay($pdo);
 ```
 - [Set-up instructions](sql/delay.md).

docs/sql/cache.md

@@ -9,14 +9,16 @@ Multiple crawlers may with benefits share the same database.
 ### Requirements:
 - MySQL
 
-Support for additional databases is possible, just [submit an issue](https://github.com/VIPnytt/RobotsTxtParser/issues) and we'll see what we can do about it.
+The library is built with cross-system in mind, and everything is set for additional database support. Just [submit an issue](https://github.com/VIPnytt/RobotsTxtParser/issues) and we'll see what we can do about it.
 
 ## Usage
 ```php
 $handler = new RobotsTxtParser\Cache($pdo);
 $client = $handler->client('http://example.com');
 ```
 
+See the [Cache class documentation](../methods/Cache.md) for more information and additional available methods.
+
 #### Cron job
 Recommended, but not required.
 

docs/sql/delay.md

@@ -1,6 +1,9 @@
 # Delay handler
 Many hosts requires you to control the robot's request flow, using a minimum interval between each request. The reasons for this isn't always obvious, and may sometimes be complicated.
 
+Did you know this number is as high as about 40% of all `robots.txt` files?
+_Source: internal statistics_
+
 Examples of a 5 second interval:
 - [`Crawl-delay: 5`](../directives.md#crawl-delay)
 - [`Cache-delay: 5`](../directives.md#cache-delay)
@@ -12,9 +15,12 @@ Multiple _user-agents_ / _crawlers_ may share the same database. The delay is ha
 ### Requirements
 - MySQL 5.6+
 
-Support for additional databases is possible, just [submit an issue](https://github.com/VIPnytt/RobotsTxtParser/issues) and we'll see what we can do about it.
+The library is built with cross-system in mind, and everything is set for additional database support. Just [submit an issue](https://github.com/VIPnytt/RobotsTxtParser/issues) and we'll see what we can do about it.
 
 ## Usage
+- See the [DelayInterface](../methods/DelayInterface.md) for client usage
+- See the [Delay class](../methods/Delay.md) for management
+
 #### Automated
 Sleep until the timestamp is reached
 ```php