how to find the non-ascii character using perl

thava · April 15th, 2009, 01:39 AM

Dear all,

Pls. tell me how to find the non-english character by regular expression like
$line =~ m/[regular expression] /g;

example:
values of these surfactantÃ¢â¬âcobalt

Thanks,
Thava

ciderpunx · April 21st, 2009, 11:44 AM

Code:

#!/usr/bin/perl
use warnings;
use strict;

while(<>) {
  tr/\000-\177//cd; 
  print;
}

mnagaraj1983 · August 11th, 2011, 06:22 AM

Hi,

How to replace the non-asciii value into the XML number entities.

eg:

values of these surfactantÃ¢â¬âcobalt

output:

values of these surfactant &#x????; cobalt

ciderpunx · November 13th, 2011, 10:24 PM

Would HTML::Entities work for you? If not something like:

Code:

#!/usr/bin/perl
use warnings;
use strict;
use utf8;
use 5.10.1;


binmode STDOUT, 'utf8'; # needed on some terminals where you don't defsault to utf8
my $unicode_string="vis-Ã -vis BeyoncÃ©'s naÃ¯ve\npapier-mÃ¢chÃ© rÃ©sumÃ©";
say "Start: $unicode_string";
$unicode_string =~s/([^[:ascii:]])/'&#' . ord($1) . ';'/ge;
say "End: $unicode_string";