Question

I’m doing a RSS spider. I want to continue with the execution of the
spider ignoring the current node if there isn’t a match in the current
item… So far I’ve got this:

        if info.startswith('Foo'):
            item['foo'] = info.split(':')[1]
        else:
            return None

(info is a string that’s sanitized from a xpath before…)

But I’m getting this exception:

    exceptions.TypeError: You cannot return an "NoneType" object from a

spider

So how can I ignore this node and continue with the execution?

Answer 1

parse(response):
    #make some manipulations
    if info.startswith('Foo'):
            item['foo'] = info.split(':')[1]
            return [item]
        else:
            return []

But better is not use return, use yield or do nothing

parse(response):
    #make some manipulations
    if info.startswith('Foo'):
            item['foo'] = info.split(':')[1]
            yield item
        else:
            return