Sign Up

Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.

Have an account? Sign In

Have an account? Sign In Now

Sign In

Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.

Sign Up Here

Forgot Password?

Don't have account, Sign Up Here

Forgot Password

Lost your password? Please enter your email address. You will receive a link and will create a new password via email.

Have an account? Sign In Now

You must login to ask a question.

Forgot Password?

Need An Account, Sign Up Here

Please briefly explain why you feel this question should be reported.

Please briefly explain why you feel this answer should be reported.

Please briefly explain why you feel this user should be reported.

Sign InSign Up

The Archive Base

The Archive Base Logo The Archive Base Logo

The Archive Base Navigation

  • Home
  • SEARCH
  • About Us
  • Blog
  • Contact Us
Search
Ask A Question

Mobile menu

Close
Ask a Question
  • Home
  • Add group
  • Groups page
  • Feed
  • User Profile
  • Communities
  • Questions
    • New Questions
    • Trending Questions
    • Must read Questions
    • Hot Questions
  • Polls
  • Tags
  • Badges
  • Buy Points
  • Users
  • Help
  • Buy Theme
  • SEARCH
Home/ Questions/Q 105653
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Editorial Team
Asked: May 11, 20262026-05-11T01:28:23+00:00 2026-05-11T01:28:23+00:00

I am learning Python and trying to figure out an efficient way to tokenize

  • 0

I am learning Python and trying to figure out an efficient way to tokenize a string of numbers separated by commas into a list. Well formed cases work as I expect, but less well formed cases not so much.

If I have this:

A = '1,2,3,4' B = [int(x) for x in A.split(',')]  B results in [1, 2, 3, 4] 

which is what I expect, but if the string is something more like

A = '1,,2,3,4,' 

if I’m using the same list comprehension expression for B as above, I get an exception. I think I understand why (because some of the ‘x’ string values are not integers), but I’m thinking that there would be a way to parse this still quite elegantly such that tokenization of the string a works a bit more directly like strtok(A,’,\n\t’) would have done when called iteratively in C.

To be clear what I am asking; I am looking for an elegant/efficient/typical way in Python to have all of the following example cases of strings:

A='1,,2,3,\n,4,\n' A='1,2,3,4' A=',1,2,3,4,\t\n' A='\n\t,1,2,3,,4\n' 

return with the same list of:

B=[1,2,3,4] 

via some sort of compact expression.

  • 1 1 Answer
  • 3 Views
  • 0 Followers
  • 0
Share
  • Facebook
  • Report

Leave an answer
Cancel reply

You must login to add an answer.

Forgot Password?

Need An Account, Sign Up Here

1 Answer

  • Voted
  • Oldest
  • Recent
  • Random
  1. 2026-05-11T01:28:24+00:00Added an answer on May 11, 2026 at 1:28 am

    How about this:

    A = '1, 2,,3,4  ' B = [int(x) for x in A.split(',') if x.strip()] 

    x.strip() trims whitespace from the string, which will make it empty if the string is all whitespace. An empty string is ‘false’ in a boolean context, so it’s filtered by the if part of the list comprehension.

    • 0
    • Reply
    • Share
      Share
      • Share on Facebook
      • Share on Twitter
      • Share on LinkedIn
      • Share on WhatsApp
      • Report

Sidebar

Ask A Question

Stats

  • Questions 137k
  • Answers 138k
  • Best Answers 0
  • User 1
  • Popular
  • Answers
  • Editorial Team

    How to approach applying for a job at a company ...

    • 7 Answers
  • Editorial Team

    How to handle personal stress caused by utterly incompetent and ...

    • 5 Answers
  • Editorial Team

    What is a programmer’s life like?

    • 5 Answers
  • Editorial Team
    Editorial Team added an answer You need to allow web service hosting out of your… May 12, 2026 at 7:27 am
  • Editorial Team
    Editorial Team added an answer Yes, as long as they are executed on the same… May 12, 2026 at 7:27 am
  • Editorial Team
    Editorial Team added an answer There are a lot of ways to accomplish this. The… May 12, 2026 at 7:27 am

Related Questions

So I am learning Python slowly, and am trying to make a simple function
I have been trying to strip out some data from HTML files. I have
I am trying to use Python's ctypes library to access some methods in the
I'm learning python for a couple of days now and am struggling with its

Trending Tags

analytics british company computer developers django employee employer english facebook french google interview javascript language life php programmer programs salary

Top Members

Explore

  • Home
  • Add group
  • Groups page
  • Communities
  • Questions
    • New Questions
    • Trending Questions
    • Must read Questions
    • Hot Questions
  • Polls
  • Tags
  • Badges
  • Users
  • Help
  • SEARCH

Footer

© 2021 The Archive Base. All Rights Reserved
With Love by The Archive Base

Insert/edit link

Enter the destination URL

Or link to existing content

    No search term specified. Showing recent items. Search or use up and down arrow keys to select an item.