RubyGems Navigation menu

wgit 0.8.0

Fundamentally, Wgit is a HTTP indexer/scraper which crawls URL's to retrieve and serialise their page contents for later use. You can use Wgit to scrape entire websites if required. Wgit also provides a means to search indexed documents stored in a database. Therefore, this library provides the main components of a WWW search engine. The Wgit API is easily extended allowing you to pull out the parts of a webpage that are important to you, the code snippets or tables for example. As Wgit is a library, it supports many different use cases including data mining, analytics, web indexing and URL parsing to name a few.

Versions:

  1. 0.8.0 - January 27, 2020 (46 KB)
  2. 0.7.0 - January 04, 2020 (45 KB)
  3. 0.6.0 - December 24, 2019 (44 KB)
  4. 0.5.1 - November 22, 2019 (31 KB)
  5. 0.5.0 - November 02, 2019 (31 KB)
Show all versions (28 total)

Runtime Dependencies (4):

Development Dependencies (8):

  • byebug ~> 10.0
  • dotenv ~> 2.5
  • maxitest ~> 3.3
  • pry ~> 0.12
  • rubocop ~> 0.74
  • toys ~> 0.8
  • webmock ~> 3.6
  • yard >= 0.9.20, < 1.0
  • Owners:

    Pushed by:

    Authors:

    • Michael Telford

    SHA 256 checksum:

    2a01aae3070a9a4f0c60c0265aae9c4f4f21be3c62f0c9232cd6d398338fa47d

    Total downloads 13,666

    For this version 496

    Gemfile:
    = Copy to clipboard Copied!

    install:
    =

    License:

    MIT

    Required Ruby Version: ~> 2.5

    Links: