MANUAL_TESTING.md

Manual Testing Checklist for Shelly

This document tracks manual testing procedures for Shelly components that require human verification beyond automated tests.

UI Testing (Shelly-UI)

Installation & Startup

• Application launches successfully on first run
• Application icon displays correctly in system tray/taskbar
• Window opens at appropriate size and position
• Application responds to window resize operations
• Application can be minimized/maximized/closed properly

Package Search & Display

• Search functionality returns relevant results
• Package list displays correctly with all metadata
• Package details view shows complete information
• Package icons/images load properly
• Scrolling through large package lists is smooth
• Filtering and sorting options work as expected

Package Installation

• Installing a package shows progress correctly
• Installation completes successfully
• Success/failure notifications display appropriately
• Dependencies are shown and handled correctly
• Disk space warnings appear when needed
• Installation can be cancelled mid-process

Package Updates

• Available updates are detected and listed
• Update all functionality works correctly
• Individual package updates work
• Update progress is displayed accurately
• Post-update notifications are shown

Package Removal

• Package removal shows dependency warnings
• Removal process completes successfully
• Orphaned packages are identified
• Confirmation dialogs appear before removal

AUR Integration

• AUR packages can be searched
• AUR package information displays correctly
• AUR packages can be installed
• AUR packages can be updated
• Build process output is visible
• AUR package removal works

Flatpak Integration

• Flatpak packages are listed separately
• Flatpak search works correctly
• Flatpak installation succeeds
• Flatpak updates work
• Flatpak removal works

Repository Management

• Repository list displays correctly
• Repository synchronization works
• Repository status indicators are accurate
• Custom repositories can be added (when implemented)

UI/UX Elements

• All buttons are clickable and responsive
• Tooltips display helpful information
• Keyboard shortcuts work as expected
• Tab navigation works properly
• Theme/styling is consistent throughout
• Text is readable and properly sized
• Icons are clear and meaningful

Error Handling

• Network errors are handled gracefully
• Permission errors show appropriate messages
• Invalid input is rejected with clear feedback
• Application doesn't crash on unexpected errors

CLI Testing (Shelly-CLI)

Basic Commands

• shelly --help displays help information
• shelly --version shows correct version
• Command syntax errors show helpful messages

Package Operations

• shelly search <package> returns results
• shelly install <package> installs successfully
• shelly remove <package> removes successfully
• shelly update updates all packages
• shelly info <package> shows package details

Repository Operations

• shelly sync synchronizes repositories
• Repository refresh works correctly
• Database updates complete successfully

AUR Commands

• AUR search works from CLI
• AUR installation works from CLI
• AUR updates work from CLI

Keyring Management

• shelly keyring init initializes keyring
• shelly keyring populate populates keys
• Keyring operations complete without errors

Output Formatting

• CLI output is properly formatted
• Colors/markup display correctly in terminal
• Progress indicators work
• Error messages are clear and actionable
• Verbose mode provides additional details

UI Mode Integration

• CLI can be called from UI successfully
• Output is properly captured and displayed in UI
• Error codes are correctly propagated

Installation & Deployment

PKGBUILD Installation

• makepkg -si builds and installs successfully
• All dependencies are correctly specified
• Post-install scripts execute properly
• Files are installed to correct locations

Web Installer

• Web install script downloads correctly
• Installation completes without errors
• All components are installed
• Desktop entries are created

AUR Installation

• Package builds via yay/paru
• All dependencies resolve correctly
• Installation completes successfully

Uninstallation

• Uninstall script removes all components
• Configuration files are handled appropriately
• No orphaned files remain

System Integration

Permissions

• Root/sudo operations work correctly
• Permission errors are handled gracefully
• User is prompted for elevation when needed

File System

• Package cache is managed correctly
• Temporary files are cleaned up
• Configuration files are preserved on update

System State

• System package database remains consistent
• No conflicts with pacman operations
• Lock files are handled correctly

Desktop Integration

• Desktop file launches application
• Application appears in application menu
• File associations work (if applicable)
• System notifications display correctly

Performance Testing

Responsiveness

• UI remains responsive during operations
• Large package lists load quickly
• Search results appear promptly
• No UI freezing during background operations

Resource Usage

• Memory usage is reasonable
• CPU usage is acceptable during operations
• Disk I/O is efficient
• Network bandwidth usage is appropriate

Cross-Platform Testing (Arch-based distros)

Arch Linux

• All features work on vanilla Arch
• Integration with pacman is seamless

Manjaro

• Compatible with Manjaro repositories
• Manjaro-specific packages work

EndeavourOS

• Works with EndeavourOS setup
• No conflicts with EndeavourOS tools

Other Arch-based

• Test on other Arch derivatives as available

Regression Testing

After Updates

• Previously working features still work
• No new crashes or errors introduced
• Performance hasn't degraded
• UI/UX remains consistent

Notes

• Date of last full manual test: _____________
• Tester: _____________
• Version tested: _____________
• Issues found: _____________

Known Issues

Document any known issues that are being tracked: