Home/ Questions/Q 8061895
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-05T10:29:26+00:00

I am writing a script which involves showing the user a webpage on the

  • 0

I am writing a script which involves showing the user a webpage on the basis of his requirements (which I take as inputs) and opening it in firefox. For instance, a crude version of this is :

#!/bin/bash
read -p "What do you want to search" search_term
link=$(echo "http://www.mywebsite_whatever.com/search?q="$search_term)
firefox $link

The major problem is I cannot wget/urllib this website since I don’t have permission.

Now what I want to do is :

Have the user look over only certain keywords on the webpage. So for that I want to either:

  1. Open firefox with the find box (Ctrl + F) ON with the keyword in it (without changing the source code of firefox)

  2. Somehow have firefox open the website, save it as html and quit. (I can’t wget) Then I can grep out keywords as desired. [Please don’t start off on how this is unethical and all. I am doing this merely as an exercise]

I am working on Linux.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Use Wget with the --user-agent switch so that the website thinks you’re using Firefox, for example

    wget --user-agent="Mozilla/5.0 (X11; Ubuntu; Linux i686; rv:12.0) Gecko/20100101 Firefox/12.0"

    Of course, for a permanent script you should instead use --user-agent="MyScript/1.0 (http://mywebsite/)" or similar so that if it goes haywire they know who to contact.

    • 0