Tweep is an advanced Twitter scraping tool written in python that allows for scraping Tweets and pictures from Twitter profiles **without** using Twitter's API.
Tweep is an advanced Twitter scraping tool written in python that allows for scraping Tweets and pictures from Twitter profiles **without** using Twitter's API, bypassing any rate limitations.
## Requirements
## Requirements
- BeautifulSoup4 `pip install beautifulsoup4`
- BeautifulSoup4 `pip install beautifulsoup4`
...
@@ -10,27 +11,55 @@ Tweep is an advanced Twitter scraping tool written in python that allows for scr
...
@@ -10,27 +11,55 @@ Tweep is an advanced Twitter scraping tool written in python that allows for scr
-`-s` Search for Tweets containing this word or phrase.
-`-s` Search for Tweets containing this word or phrase.
-`--year` Filter tweets before the specified year.
-`--year` Filter tweets before the specified year.
-`--pics` Download all the pictures from Tweets.
-`--pics` Download all the pictures from Tweets.
-`--fruit` Display Tweets with "low-hanging-fruit"
-`--fruit` Display Tweets with "low-hanging-fruit".
-`--tweets` Display Tweets only.
-`--verified` Display Tweets only from verified users (Use with `-s`).
-`--users` Display users only (Use with `-s`).
## Examples and Combos.
## Basic Examples and Combos.
These are just a few examples to help you understand how everything works. You can mix and match each feature to your liking.
These are just a few simple examples to help you understand the basics of how to use Tweep:
Tweep is an advanced Twitter scraping tool written in python that allows for scraping Tweets and pictures from Twitter profiles **without** using Twitter's API.
This will scrape all the Tweets from that user's timeline.
python tweep.py -u username -s pineapple
## Benefits
This will scrape all Tweets that contain the word pineapple from the user's timeline.
Some of the benefits of using Tweep vs Twitter API:
- Fast initial setup
- Can be used anonymously
- No rate limitations
- Can fetch __all__ Tweets (Twitter API limits to last 3200 Tweets)
python tweep.py -s pineapple
## Requirements
This will collect every Tweet that contains the word pineapple from everyone's Tweets.
- BeautifulSoup4 `pip install beautifulsoup4`
## Usage
-`-u` The user's Tweets you want to scrape.
-`-s` Search for Tweets containing this word or phrase.
-`--year` Filter tweets before the specified year.
-`--pics` Download all the pictures from Tweets.
-`--fruit` Display Tweets with "low-hanging-fruit".
-`--tweets` Display Tweets only.
-`--verified` Display Tweets only from verified users (Use with `-s`).
-`--users` Display users only (Use with `-s`).
python tweep.py -u username --year 2014
## Low-Hanging Fruit
This will collect Tweets that were tweeted **before** 2014.
The `--fruit` feature will display Tweets that *might* contain sensitive info such as:
- Profiles from leaked databases (Myspace or LastFM)
- Email addresses
- Phone numbers
python tweep.py -u username --pics
## Basic Examples and Combos.
This collects all the Tweets that have pictures in the user's timeline and downloads them.
A few simple examples to help you understand the basics:
python tweep.py -u username --fruit
-`python tweep.py -u username` - Scrape all the Tweets from *user*'s timeline.
This searches for Tweets that *might* contain MySpace/LastFM profiles, emails, and/or phone numbers.
-`python tweep.py -u username -s pineapple` - Scrape all Tweets from the *user*'s timeline containing _pineapple_.
-`python tweep.py -s pineapple` - Collect every Tweet containing *pineapple* from everyone's Tweets.
-`python tweep.py -u username --year 2014` - Collect Tweets that were tweeted **before** 2014.
-`python tweep.py -u username --pics` - Download all pictures from *user*'s timeline.
-`python tweep.py -u username --fruit` - Show Tweets with low-hanging fruit.
-`python tweep.py -s "Donald Trump" --verified --users` - List verified users that Tweet about Donald Trump.
## Example String
`881653591265746945 2017-07-02 23:19:31 UTC <dqt> i need to drink more water`
