If you have spaces in your file name then you must use both quotes and escape the spaces:
scp example.com:~/some/file/'with\ spaces' .
scp example.com:~/some/file/"with\ spaces" .
Or use a combo of single and double quotes:
scp 'example.com:~/some/file/"with spaces"' .