Commits

Breadcrumbs

History for

ondev

User selector

All users

All time

Commit History

Commits on Jan 16, 2022

• Add RetryMiddleware

  pavlokomarov

  committed
  58d3327

  Copy full SHA for 58d3327

• Make RequestScheduler share to possible add requests from outside of Engine

  pavlokomarov

  committed
  ccc7943

  Copy full SHA for ccc7943

• Handling exceptions in ExceptionMiddlewares

  pavlokomarov

  committed
  53f1d8c

  Copy full SHA for 53f1d8c

Commits on Jan 6, 2022

• Add option to override spider configuration when starting a run

  ksassnowski

  committed
  334c37c

  Copy full SHA for 334c37c

• Add tests for RunFactory

  ksassnowski

  committed
  555ce6d

  Copy full SHA for 555ce6d

Commits on Dec 28, 2021

• Add middleware to get response body after executing javascript

  ksassnowski

  committed
  92f39e6

  Copy full SHA for 92f39e6

• Add method to update response body to `Response` class

  ksassnowski

  committed
  18cb3e3

  Copy full SHA for 18cb3e3

Commits on Dec 27, 2021

• Simplify cookie middleware to set guzzle cookie option instead

  ksassnowski

  committed
  e4aa037

  Copy full SHA for e4aa037

• Add method to add guzzle option to request

  ksassnowski

  committed
  95612e9

  Copy full SHA for 95612e9

• Add option to define HTTP method and guzzle request options

  ksassnowski

  committed
  ff266d4

  Copy full SHA for ff266d4

Commits on Dec 26, 2021

• Add LoggerExtension and StatsCollectorExtension as defaults

  ksassnowski

  committed
  93e57a4

  Copy full SHA for 93e57a4

• Add CookieMiddleware

  ksassnowski

  committed
  cfd4922

  Copy full SHA for cfd4922

• Run cs-fixer

  ksassnowski

  committed
  28a36ec

  Copy full SHA for 28a36ec

• Make it possible to override initialRequests method

  ksassnowski

  committed
  0147584

  Copy full SHA for 0147584

Commits on Dec 23, 2021

• Add `MaximumCrawlDepthMiddleware`

  ksassnowski

  committed
  9296dd4

  Copy full SHA for 9296dd4

• Handle case where `configure` method has not been called yet in `Configurable`

  ksassnowski

  committed
  dbcab4a

  Copy full SHA for dbcab4a

• Run cs-fixer

  ksassnowski

  committed
  bd321dd

  Copy full SHA for bd321dd

• Fix doc block

  ksassnowski

  committed
  82468d4

  Copy full SHA for 82468d4

• Don’t wrap downloader middleware if it already implements full interface

  ksassnowski

  committed
  776c018

  Copy full SHA for 776c018

• Add suffix to SpiderMiddlewareInterface; move to root `Spider` namespace

  ksassnowski

  committed
  f3b507b

  Copy full SHA for f3b507b

• Don’t wrap spider middleware if it already implements full interface

  ksassnowski

  committed
  73636bc

  Copy full SHA for 73636bc

• Rename handlers to "middleware"; delete base handler class

  ksassnowski

  committed
  786da69

  Copy full SHA for 786da69

• Merge `ResponseProcessing` namespace with `Spider` namespace

  ksassnowski

  committed
  c14080a

  Copy full SHA for c14080a

Commits on Dec 22, 2021

• Run cs-fixer

  ksassnowski

  committed
  d4a869c

  Copy full SHA for d4a869c

• Make `run` property public in `RunFinished` and `RunStarting` events

  ksassnowski

  committed
  0e84187

  Copy full SHA for 0e84187

• Clean up doc blocks after removing Extension base class

  ksassnowski

  committed
  a5e5ce2

  Copy full SHA for a5e5ce2

• Run cs-fixer

  ksassnowski

  committed
  b302862

  Copy full SHA for b302862

• Extract Configurable trait; get rid of base middleware base classes

  ksassnowski

  committed
  fa75a5e

  Copy full SHA for fa75a5e

Commits on Dec 18, 2021

• Only request robots.txt once for same domain

  ksassnowski

  committed
  726fe61

  Copy full SHA for 726fe61

Commits on Dec 16, 2021

• Fix psalm errors

  ksassnowski

  committed
  c4f4490

  Copy full SHA for c4f4490

• wip

  ksassnowski

  committed
  c4f0f9c

  Copy full SHA for c4f0f9c

Commits on Aug 27, 2021

• wip

  ksassnowski

  committed
  3751a0e

  Copy full SHA for 3751a0e

Commits on Aug 26, 2021

• wip

  ksassnowski

  committed
  6ac45aa

  Copy full SHA for 6ac45aa

• wip

  ksassnowski

  committed
  44551b2

  Copy full SHA for 44551b2

Commits on Aug 24, 2021

• wip

  ksassnowski

  committed
  ce6f752

  Copy full SHA for ce6f752