Runway AI Connector

The Runway AI connector integrates Agentcy with Runway's generative AI platform. It provides 3 live tools for generating videos from text or images, and generating images from text prompts.

Authentication

The connector authenticates using a Runway API key.

{
  "name": "Runway AI",
  "source_type": "runway",
  "config": {
    "api_key": "rw_...",
    "default_model": "gen3",
    "default_duration": 4,
    "default_ratio": "16:9"
  }
}

Variable	Required	Description
api_key	Yes	Runway API key
default_model	No	Default video generation model
default_image_model	No	Default image generation model
default_duration	No	Default video duration in seconds
default_ratio	No	Default aspect ratio (e.g., 16:9, 1:1, 9:16)
enabled_tools	No	Tools to enable: video, image

Live Tools (3)

Tool	Description	Arguments
runway_text_to_video	Generate a video from a text prompt	prompt, model?, duration?, ratio?
runway_image_to_video	Generate a video from a source image and prompt	image_url, prompt?, model?, duration?, ratio?
runway_text_to_image	Generate an image from a text prompt	prompt, model?, ratio?, num_images?

Example: Agent Using Runway Tools

User: "Create a 4-second video of a sunset over the ocean"

Agent: I'll generate the video.
→ Calls runway_text_to_video(prompt: "Cinematic sunset over a calm ocean, golden hour light reflecting on waves, slow camera pan", duration: 4, ratio: "16:9")
→ Returns: generation job ID, polls for completion
→ Reports: "Video generated successfully (4s, 16:9, 1280x720). Download: [link]"

User: "Turn this product photo into a video"

Agent: I'll animate the image.
→ Calls runway_image_to_video(image_url: "https://...", prompt: "Smooth camera orbit around the product, studio lighting", duration: 4)
→ Returns: animated video of the product image

ETL Ingestion

This connector does not support ETL ingestion. All tools operate as live calls to the Runway generative API.

Configuration Reference

{
  "name": "Runway AI",
  "source_type": "runway",
  "config": {
    "api_key": "rw_...",
    "default_model": "gen3",
    "default_image_model": null,
    "default_duration": 4,
    "default_ratio": "16:9",
    "enabled_tools": ["video", "image"]
  }
}

Field	Type	Default	Description
api_key	string	required	Runway API key
default_model	string	--	Default video generation model
default_image_model	string	--	Default image generation model
default_duration	number	4	Default video duration in seconds
default_ratio	string	16:9	Default aspect ratio
enabled_tools	string[]	all	Tools to enable: video, image

Troubleshooting

Error	Cause	Fix
401 Unauthorized	Invalid API key	Verify your Runway API key
Insufficient credits	Account has no remaining credits	Purchase more credits on the Runway platform
Generation failed	Prompt was rejected by content filter	Revise the prompt to comply with Runway's content policy
Timeout	Generation took too long	Retry the request or use a shorter duration
Invalid image URL	Source image is inaccessible	Use a publicly accessible image URL
Unsupported ratio	Aspect ratio not supported	Use 16:9, 1:1, or 9:16