otty / apps
All apps/Scrapy

Scrapy

scrapy
Runs as scrapy|macOS, Linux, Windows|docs.scrapy.org
Open form in Otty otty.toml

Command form

ai-draft · 4 tasks · 10 fields

Run a spider, fetch a URL or create a project. Interactive shell, parse, settings and custom commands are left out.

Opens the form; the finished command lands at your prompt, unrun
Run in Otty
otty gui scrapy

scrapy crawl

Run a spider

Start crawling with a spider from the current project and optionally save items to a file.

Run a spiderExample values, fixed in this page — nothing here reaches a terminal
Basic
Spider name*
string
Advanced
Spider arguments
string
TasksEach one presets the form for one job
Run a spider
spiderspider_arg
Run and export items
spideroutputoverwrite_outputspider_arg
ParametersOnly these flags are editable in the form
Spider name
string · positional 0
Spider arguments
One NAME=VALUE per entry.
string · repeatable
-a
Append items to file
Append to the file; add :FORMAT to the name to pick the format.
string
--output-o
Overwrite items file
Replace the file's existing content; add :FORMAT to the name to pick the format.
string
--overwrite-output-O

scrapy fetch

Fetch a URL

Download a URL with the Scrapy downloader and print it to standard output.

Fetch a URLExample values, fixed in this page — nothing here reaches a terminal
Basic
URL*
url
Print headers only
--headers
Do not follow redirects
--no-redirect
Advanced
Force spider
string
TasksEach one presets the form for one job
Fetch a page
urlheadersno_redirectspider
ParametersOnly these flags are editable in the form
URL
url · positional 0
Print headers only
boolean
--headers
Do not follow redirects
boolean
--no-redirect
Force spider
string
--spider

scrapy startproject

Create a project

Create a new Scrapy project directory.

Create a projectExample values, fixed in this page — nothing here reaches a terminal
Basic
Project name*
string
Project directory
directory
TasksEach one presets the form for one job
New project
project_nameproject_dir
ParametersOnly these flags are editable in the form
Project name
string · positional 0
Project directory
Defaults to the project name.
path · positional 1
SourcesEvery flag above is checked against these
docs
Syntax: scrapy crawl <spider> -a NAME=VALUE: set a spider argument (may be repeated) --output FILE or -o FILE: append scraped items to the end of FILE (use - for stdout). To define the output format, set a colon at the end of the output URI (i.e. -o FILE:FORMAT) --overwrite-output FILE or -O FILE: dump scraped items into FILE, overwriting any existing file.…
manuallatest 2026-10

docs.scrapy.org

docs
Syntax: scrapy fetch <url> --spider=SPIDER: bypass spider autodetection and force use of specific spider --headers: print the request's and response's HTTP headers instead of the response's body --no-redirect: do not follow HTTP 3xx redirects (default is to follow them)
manuallatest 2026-10

docs.scrapy.org

docs
Syntax: scrapy startproject <project_name> [project_dir]
manuallatest 2026-10

docs.scrapy.org

Before it fills your prompt, Otty checks the installed scrapy against its version. A form that does not match your version is not offered.