how to find the non-ascii character using perl

thava · #1 (**permalink**) April 15th, 2009, 01:39 AM

Dear all,

Pls. tell me how to find the non-english character by regular expression like
$line =~ m/[regular expression] /g;

example:
values of these surfactantâ€“cobalt

Thanks,
Thava

ciderpunx · #2 (**permalink**) April 21st, 2009, 11:44 AM

Code:

#!/usr/bin/perl
use warnings;
use strict;

while(<>) {
  tr/\000-\177//cd; 
  print;
}

mnagaraj1983 · #3 (**permalink**) August 11th, 2011, 06:22 AM

Hi,

How to replace the non-asciii value into the XML number entities.

eg:

values of these surfactantâ€“cobalt

output:

values of these surfactant &#x????; cobalt

ciderpunx · #4 (**permalink**) November 13th, 2011, 10:24 PM

Would HTML::Entities work for you? If not something like:

Code:

#!/usr/bin/perl
use warnings;
use strict;
use utf8;
use 5.10.1;


binmode STDOUT, 'utf8'; # needed on some terminals where you don't defsault to utf8
my $unicode_string="vis-à-vis Beyoncé's naïve\npapier-mâché résumé";
say "Start: $unicode_string";
$unicode_string =~s/([^[:ascii:]])/'&#' . ord($1) . ';'/ge;
say "End: $unicode_string";

Need to download code?

Navigation