Scraping Twitter Profile Tweets
Raw data collection. No assumed use case — returns the full dataset for downstream analysis.
Inputs
| Parameter | Type | Required | Default | Notes |
|---|---|---|---|---|
startUrls | array | Optional | [] | Twitter profile URLs (x.com or twitter.com formats) |
twitterHandles | array | Optional | [] | Twitter usernames (without @) |
start | string | Optional | — | Tweets after this date (YYYY-MM-DD or YYYY-MM-DD_HH:MM:SS_UTC) |
end | string | Optional | — | Tweets before this date (YYYY-MM-DD or YYYY-MM-DD_HH:MM:SS_UTC) |
includeNativeRetweets | boolean | Optional | false | Include native retweets in results |
onlyImages | boolean | Optional | false | Only tweets containing images |
getReplies | boolean | Optional | false | Include tweet replies |
minReplyCount | number | Optional | — | Minimum reply count threshold |
getAboutData | boolean | Optional | false | Fetch full profile about data |
maxItems | number | Optional | Unlimited | Maximum tweets to return |
customMapFunction | string | Optional | — | JavaScript function to transform each output object |
How to Run
Using run_actor.js (recommended)
# Quick answer (table)
node scripts/run_actor.js --actor "apidojo~twitter-profile-scraper" --input '{"twitterHandles": ["elonmusk"], "maxItems": 100}'
# Save as CSV
node scripts/run_actor.js --actor "apidojo~twitter-profile-scraper" --input '{"twitterHandles": ["elonmusk"], "maxItems": 100}' --output results.csv --format csv
# Save as JSON
node scripts/run_actor.js --actor "apidojo~twitter-profile-scraper" --input '{"twitterHandles": ["elonmusk"], "maxItems": 100}' --output results.json --format json
REST API fallback
curl -X POST "https://api.apify.com/v2/acts/apidojo~twitter-profile-scraper/runs" \
-H "Authorization: Bearer $APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{"twitterHandles": ["elonmusk"], "maxItems": 100}'
If Apify MCP is available:
Use the Apify MCP call_actor tool with actor apidojo~twitter-profile-scraper and the input above.
Output Fields
| Field | Type | Description |
|---|---|---|
type | string | Always tweet |
id | string | Tweet ID |
url | string | Tweet URL (x.com) |
twitterUrl | string | Tweet URL (twitter.com) |
text | string | Tweet text content |
retweetCount | number | Retweet count |
replyCount | number | Reply count |
likeCount | number | Like count |
quoteCount | number | Quote tweet count |
bookmarkCount | number | Bookmark count |
createdAt | string | Creation timestamp |
lang | string | Detected language |
isReply | boolean | Whether this is a reply |
isRetweet | boolean | Whether this is a retweet |
isQuote | boolean | Whether this is a quote tweet |
source | string | Twitter client used |
author.userName | string | Author @username |
author.name | string | Author display name |
author.isVerified | boolean | Legacy verification |
author.isBlueVerified | boolean | Twitter Blue verification |
author.profilePicture | string | Author profile picture URL |
author.followers | number | Author follower count |
Edge Cases
- Private account: Returns 0 tweets. Tell user the account is private.
- Account suspended: Returns error. Handle may be banned.
- Very active account: Use maxItems to cap and control cost ($0.0004 per extra tweet).
- Date range: Minimum 50 results needed for the query to run. If few tweets in range, widen date range.
- Retweets in results: Actor returns all public tweets including retweets.