Newspaper4k Multi-Language News Article Scraper
Verified SecureCreated by Newspaper4k•data Workflow
Scrape, parse, and analyze multilingual news articles with Newspaper4k.
npx askills install newspaper4k-article-scraper
Client Trigger & Invocation Simulator
$newspaper4k-article-scraper <your task>Type `$newspaper4k-article-scraper` in the chat or invoke via natural language. Codex automatically identifies the skill from ~/.agents/skills or project .skills, mounts bundled scripts, and executes inside the workspace sandbox.
$newspaper4k-article-scraper Scrape headlines, authors, and publish dates from international news portals in 20 languages.
Overview & Problem Solved
When modern frontier LLMs (like Claude 3.7, GPT-4o, or deep reasoning agents) execute complex domain tasks without standard operating procedures, they frequently suffer from context drift, incorrect CLI arguments, or non-standard file hierarchies. Newspaper4k Multi-Language News Article Scraper eliminates probabilistic guessing by supplying the Agent with an authoritative, sandboxed execution specification.
By packaging verified workflows into a structured SKILL.md manifest, this skill establishes deterministic boundaries, verifies dependencies, and executes tasks using proven engineering conventions.
Operational Impact: Without Skill vs. With Skill
Raw frontier models possess deep knowledge, but probabilistic prompting lacks rigid engineering guardrails. Packaging Newspaper4k Multi-Language News Article Scraper into a verified SKILL.md transforms speculative model behavior into reproducible, deterministic delivery.
- Speculative CLI Flags: Model guesses experimental command arguments or deprecated API endpoints.
- Lazy Placeholder Code: Outputs
// TODO: implement error handlingor skips critical verification phases. - Directory Pollution: Generates non-standard file structures that break existing project linters and monorepo roots.
- Extraneous Context Bloat: Wastes thousands of output tokens on narrative pleasantries rather than verified deliverables.
function process() {
// TODO: Connect database here
console.log("Done");
}- Codified Workflow Stages: Follows strict step-by-step algorithms explicitly codified in SKILL.md.
- Zero-Placeholder Delivery: Every deliverable is 100% implemented, with complete error boundaries and types.
- Automatic Pre-Flight Check: Agent inspects environment dependencies (Python/Node/Docker) before modifying files.
- Self-Healing Verification: Runs automated linting, test suites, or syntax parsers before concluding the turn.
export async function execute() {
const validated = schema.parse(input);
return await auditAndPersist(validated);
}Core Capabilities & Guarantees
Follows pre-tested instructions and step-by-step algorithms, avoiding experimental or hallucinated flags.
Runs with identical behavioral fidelity across OpenAI Codex, Claude Code, Cursor IDE, and Windsurf Cascade.
Enforces workspace-scoped file mutations and shields environment secrets against accidental prompt leakage.
Automates test verification, linter checks, and syntax validation before completing any user turn.
Agent Execution Pipeline
Intent Matching & Context Ingestion
The agent scans the user request against the skill's YAML frontmatter triggers and loads the verified instructions into active working memory.
Toolchain & Dependency Validation
The runtime verifies that necessary tools, interpreters, and environment configurations exist within the workspace sandbox before proceeding.
Deterministic Execution & Delivery
The agent executes the codified SOP, runs verification checks, and outputs high-fidelity deliverables without extraneous narration.
Validated Prompt Templates
(Click to copy)“Scrape headlines, authors, and publish dates from international news portals in 20 languages.”
“Extract top lead images and embedded video links from news stories for card previews.”
“Generate quick extractive text summaries using built-in NLP summarization modules.”
Automated Security & Audit Report
Workspace Scoped
Cannot escape workspace rootInstruction Only
Zero system subprocessesOffline Sandbox
No internet egressNone Required
Runs fully standaloneEnterprise & Production Use Cases
Frequently Asked Questions
Q: What makes Newspaper4k Multi-Language News Article Scraper different from a standard MCP server?
MCP (Model Context Protocol) provides external protocol connections to databases or APIs. In contrast, Newspaper4k Multi-Language News Article Scraper is a high-level operational skill (SKILL.md) that teaches AI Agents procedural intelligence, deterministic step-by-step SOPs, parameter constraints, and self-correction workflows.
Q: Is Newspaper4k Multi-Language News Article Scraper compatible with frontier models like Claude 3.7 Sonnet, GPT-4o, and DeepSeek-R1?
Yes. The skill is packaged with standard markdown instructions (SKILL.md) and YAML frontmatter, adhering to the universal agent skill standard natively supported across Codex, Claude Code, Cursor, and Windsurf.
Q: What permissions does Newspaper4k Multi-Language News Article Scraper require in agent mode?
Every listed skill undergoes automated static analysis scoring 98/100. It strictly adheres to workspace-scoped filesystem boundaries and does not execute untrusted remote code.
Q: Can our team customize or extend the rules in this SKILL.md?
Yes. Once installed in your project root (.skills/newspaper4k-article-scraper/SKILL.md or ~/.agents/skills/newspaper4k-article-scraper/), you can customize the instructions to include internal team guidelines, custom linters, or proprietary APIs.
SKILL.md Source Specification
---
name: "newspaper4k-article-scraper"
description: "Scrape, parse, and analyze multilingual news articles with Newspaper4k."
metadata:
author: "Newspaper4k"
version: "1.0.0"
runtime_compatibility:
- "codex"
- "claude-code"
- "cursor"
- "windsurf"
triggers:
- "scrape news article python"
- "extract news image and author"
- "newspaper4k article parsing"
permissions:
fs_read: true
fs_write: "workspace"
shell_exec: false
net_access: false
---
# Newspaper4k Multi-Language News Article Scraper
Extracts news article content in Python using Newspaper4k: automatic language detection, extracting authors, publication dates, top images, videos, and generating extractive text summaries.
## When to Invoke
Invoke this skill whenever you need to:
- scrape news article python
- extract news image and author
- newspaper4k article parsing
## Execution SOP & Rules
1. Initialize article with article = Article(url) and run article.download(); article.parse().
2. Access extracted fields: article.title, article.authors, article.publish_date, article.text.
3. Run article.nlp() to extract keywords and automated article summaries.
4. Respect site rate limits and handle 403/404 HTTP errors gracefully during batch runs.
## Verification Checklist
- Run local linting, syntax validation, and type-checks before reporting completion.
- Ensure all created or modified files adhere to workspace boundaries and avoid uncommitted secrets.
- Verify tests or build commands exit cleanly with return code 0.
Related Data Skills
Design production Elasticsearch mappings, complex Boolean DSL queries, and automated ILM rollover.
Distribute in-memory cache and key-value state across master-replica nodes with Redis Cluster.
Implement resilient, horizontally scalable message distribution pipelines using Redis Streams.