
using-screenshots
✓ Official★ 4,933by microsoft · part of microsoft/fluidframework
The assistant can in fact see your screen — this has it take the picture itself and then look at what is on it, rather than replying that it has no way to.
WHEN YOUR AGENT SHOULD USE IT
A QUICK BOUNDARYUSE FOR
- Take a screenshot of your screen to debug a visual UI bug.
- Capture an interactive area-selection screenshot on macOS or Linux.
- Review a captured screenshot for layout or alignment problems in a UI.
This is the playbook your agent receives when the skill activates — you don't need to read it to use the skill, but it's here to audit before installing.
Taking and Analyzing Screenshots
Overview
You CAN take screenshots by combining the Bash tool with platform-specific screenshot commands. Screenshots are saved as image files, then loaded into your context using the Read tool for visual analysis.
When to Use
Use this skill when I ask you to:
- "Take a screenshot"
- "Look at my screen"
- "Analyze this UI bug visually"
- "Review what's currently displayed"
- "Capture and examine the interface"
Quick Reference
| Platform | Command | Interactive Selection |
|---|---|---|
| macOS | screencapture | -i flag (area selection) |
| Linux | gnome-screenshot, scrot, or import | -a or -s flag |
Standard workflow:
- Detect platform with
uname -s - Check for available screenshot tool
- Capture to
/tmp/screenshot_$(date +%s).png - Use Read tool with the file path
- Analyze the image
- Optionally clean up temp file
Step-by-Step Instructions
1. Detect Platform
uname -s- Returns
Darwinfor macOS - Returns
Linuxfor Linux
2. Check Available Tools
macOS: screencapture is always available (built-in)
Linux: Check in priority order:
which gnome-screenshot || which scrot || which import || echo "none"Priority order (best compatibility):
gnome-screenshot- works on both X11 and Waylandscrot- lightweight, X11 onlyimport- part of ImageMagick
3. Capture Screenshot
Use timestamped filename to avoid conflicts:
macOS:
screencapture -i /tmp/screenshot_$(date +%s).png-ienables interactive area selection- User clicks and drags to select region
Linux with gnome-screenshot:
gnome-screenshot -af /tmp/screenshot_$(date +%s).png-afor area selection-fspecifies filename
Linux with scrot:
scrot -s /tmp/screenshot_$(date +%s).png-senables selection mode
Linux with import:
import /tmp/screenshot_$(date +%s).png- Provides crosshair for click-and-drag selection
4. Load Image into Context
Read tool: file_path="/tmp/screenshot_12345.png"The Read tool displays images visually. You'll see the screenshot and can analyze it.
5. Analyze the Image
Once loaded, you can:
- Identify UI elements
- Spot visual bugs
- Review design elements
- Read text content
- Examine layout issues
6. Optional Cleanup
rm /tmp/screenshot_12345.pngOnly remove if I won't need the file again.
Handling Missing Tools
If no screenshot tool is available on Linux:
-
Inform me which tool is missing
-
Suggest installation:
- Ubuntu/Debian:
sudo apt install gnome-screenshot - Fedora:
sudo dnf install gnome-screenshot - Arch:
sudo pacman -S gnome-screenshot - ImageMagick:
sudo apt install imagemagick(or equivalent)
- Ubuntu/Debian:
-
Alternative: Ask user to manually take screenshot and provide path
Common Mistakes
❌ Saying "I cannot take screenshots"
Reality: You CAN via Bash + screenshot CLI tools
❌ Forgetting to use Read tool after capture
Reality: The screenshot file must be loaded with Read tool to see it
❌ Using relative paths
Reality: Always use absolute paths (/tmp/...) for Read tool
❌ Not checking for available tools on Linux
Reality: Must detect which tool is installed before attempting capture
Example Workflow
User: "Take a screenshot and help me debug this UI bug"
1. Check platform:
uname -s → Linux
2. Check available tools:
which gnome-screenshot → /usr/bin/gnome-screenshot
3. Capture screenshot:
gnome-screenshot -af /tmp/screenshot_1729012345.png
→ User selects area, file saved
4. Load into context:
Read: file_path="/tmp/screenshot_1729012345.png"
→ Image displays visually
5. Analyze:
"I can see the button alignment is off. The 'Submit' button
is 5px lower than the 'Cancel' button..."
6. Optional cleanup:
rm /tmp/screenshot_1729012345.pngInstall this skill from microsoft/fluidframework on GitHub. It only works when installed from that project, so don't copy the skill's file out on its own.
npx skills add microsoft/fluidframework --skill "using-screenshots" --full-depthRun this in your project — your agent picks the skill up automatically.
BEFORE IT WILL WORK
Nothing — it works as soon as it is installed.
Licensed under MIT— you can use, modify, and redistribute it under that license's terms.
View the full license file on GitHub →