Name: url-metadata-extract
Price: 0.003 USDC
Availability: InStock

$ man url-metadata-extract

agentutility / web-probe / url-metadata-extract

PRICE / CALL

$0.003

USDC · base mainnet · scheme: exact

METHOD

POST

CLUSTER

webprobe

CATEGORY

uncategorized

STATUS

● live

NAME

url-metadata-extract — extracts page metadata from any url: title, description, open graph and twitter card tags, canonical link, and favicon

SYNOPSIS

POST https://x402.agentutility.ai/url-metadata-extract
     Content-Type: application/json
     X-PAYMENT:    <signed-transferWithAuthorization>

     { ... }

↳ first call → 402 Payment Required. Sign USDCtransferWithAuthorization, retry with theX-PAYMENT header.

DESCRIPTION

Extracts page metadata from any URL: title, description, Open Graph and Twitter Card tags, canonical link, and favicon. Also parses html lang, keywords, robots, author, article:published_time, and JSON-LD blocks, returning absolute URLs for image and favicon. Useful for SEO audits, link-preview generation, content cataloging, RAG ingestion. Use it as an OG tags parser, meta tag extractor, link preview builder, favicon resolver, JSON-LD reader, or canonical URL extractor.

INPUT — request schema

property	type	description	req?
url	string	Page URL (http or https) to fetch and parse.	required
user_agent	string	Optional User-Agent header sent on fetch.	optional
follow_redirects	boolean	Default true.	optional

OUTPUT — response shape

field	type	description
url	string	Original URL that was requested for metadata extraction.
final_url	string	Final URL after following redirects from the original request.
status	string	HTTP status code or fetch status returned by the upstream page.
title	string	Page title from the <title> tag or og:title fallback.
description	string	Meta description tag content or og:description fallback.
image	string	Absolute URL of the og:image or twitter:image preview image.
canonical	string	Canonical URL declared via <link rel="canonical"> in the page head.
favicon	string	Absolute URL of the page's favicon resolved from link tags or /favicon.ico.
language	string	Page language code from the html lang attribute (e.g. en, en-US).
og	string	Open Graph properties parsed from og:* meta tags as a key-value map.
twitter	string	Twitter Card properties parsed from twitter:* meta tags as a key-value map.
json_ld	string	JSON-LD structured data blocks extracted from <script type="application/ld+json"> tags.

EXAMPLES — two ways to call

EXAMPLE 1 · curl

curl -X POST https://x402.agentutility.ai/url-metadata-extract \
  -H 'Content-Type: application/json' \
  -d '{ }'

first response = 402 Payment Required with payment requirements; sign + retry with X-PAYMENT.

EXAMPLE 2 · mcp

# Install the MCP package for this endpoint's cluster
npx -y @agentutility/mcp-<cluster>

# Required: EVM private key with USDC on Base
export X402_PRIVATE_KEY=0x...

# Then call the url-metadata-extract tool from your MCP-aware agent.

MCP server handles payment automatically — your coding agent just calls the tool by name.

METADATA

tags: web-probeurl-metadataopen-graphtwitter-cardlink-previewjson-ldfaviconmeta-tags
methods: POST
cluster: webprobe
price: $0.003 USDC per call

ADJACENT — other endpoints in webprobe

endpoint	description	price
crates-io-stats	Fetches the public crates.io API record for a Rust crate and returns description, license, repository, homepage, documentation, keywords,…	$0.003
crypto-news-api	Returns recent cryptocurrency headline metadata and sentiment.	$0.003
homoglyph-check	Detects Unicode lookalike characters that impersonate ASCII Latin letters, a common phishing-domain trick.	$0.003
jwt-decode	Decodes a JWT and inspects its claims without needing the signing key.	$0.003
npm-package-stats	Fetches the public npm registry record for a package and returns description, license, repository, latest version, total version count, r…	$0.003
pypi-package-stats	Fetches the public PyPI JSON record for a Python package and returns summary, license, homepage, repository, documentation, issues URL, a…	$0.003
keyword-suggest	Keyword and autocomplete suggestions for any seed query.	$0.002
arxiv-bibtex	Turns an arXiv paper into a BibTeX entry: pulls title, authors, year, abstract, and DOI from the arXiv API and generates a properly-forma…	$0.005