regex utf8 and umlaut (Perl/CGI)

[thread]18471[/thread]

regex utf8 and umlaut

Tags: perl5 CGI regex Similar Threads

Readers: 16

Articles: hide open all | hide show old branches

+10 replies
guest curupira

2013-07-26 14:20
hello,

I have a problem with with my regex changing umlauts and other special characters and need a little help. All code and system is UTF-8. I wrote a test-program now, which should change ö to oe and any éè to e:
Code (perl): (dl )

1 2 3 4 5 6 7 8 9 10 11 12 13

#!/usr/bin/perl $text="ö"; print "$text 2\n"; $text =~ s/[éè]/e/g; print "$text 3\n"; $text =~ s/[öÖ]/oe/g; print "$text 4\n";
the output looks like this:
Code: (dl )

1 2 3 4 5

/tmp$ ./umlautregex.pl ö 2 e� 3 eoe 4 /tmp$
what's wrong with it?
- +7 replies
- lichtkind
  
  2013-07-26 14:21
  User since
  2004-03-22
  5709 articles
  ModeratorIn + EditorIn
  how about insert
  
  Code (perl): (dl )
  
  1 2 3
  
  #!/usr/bin/perl use utf;
  
  Tutorien in der Wiki, mein zeug:
  kephra, baumhaus, garten, gezwitscher
  
  Es beginnt immer mit einer Entscheidung.
  - +3 replies
  - guest curupira
    
    2013-07-26 14:29
    gives:
    
    Code: (dl )
    
    1 2 3 4 5
    
    /tmp$ ./umlautregex.pl � 2 � 3 oe 4 /tmp$
    
    any other suggestions?
    Last edited: 2013-07-26 14:38:57 +0200 (CEST)
    - renee
      
      2013-07-26 15:19
      
      User since
      2003-08-04
      14371 articles
      ModeratorIn
      
      That seems to be correct... What charset do you use for your terminal? Can you use Devel::Peek to show what your variable contains?
      OTRS-Erweiterungen (http://feature-addons.de/)
      Frankfurt Perlmongers (http://frankfurt.pm/)
      --
      
      Unterlagen OTRS-Workshop 2012: http://otrs.perl-services.de/workshop.html
      Perl-Entwicklung: http://perl-services.de/
    - Linuxer
      
      2013-07-26 15:26
      
      User since
      2006-01-27
      3891 articles
      HausmeisterIn
      
      Did you change STDOUT to 'utf8'? This works for me:
      
      Code (perl): (dl )
      
      1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
      
      #! /usr/bin/env perl use strict; use warnings; use utf8; use 5.14.0; binmode(STDOUT, ':utf8'); my $str = 'Wölle'; say "Original: $str"; $str =~ s/[éè]/e/g; say "after s/e/e/: $str"; $str =~ s/[öÖ]/oe/g; say "after s/ö/oe/: $str";
      
      Output:
      
      Code: (dl )
      
      1 2 3
      
      Original: Wölle after s/e/e/: Wölle after s/ö/oe/: Woelle
      
      meine Beiträge: I.d.R. alle Angaben ohne Gewähr und auf Linux abgestimmt!
      Die Sprache heisst Perl, nicht PERL. - Bitte Crossposts als solche kenntlich machen!
  - +3 replies
  - GwenDragon
    
    2013-07-26 14:57
    User since
    2005-01-17
    14850 articles
    Admin1
    
    No, my dear. You should write:
    
    Code (perl): (dl )
    
    use utf8;
    
    Yo may answer in german language if you like ;)
    Last edited: 2013-07-26 14:59:51 +0200 (CEST)
    die Drachin Gwen
    
    Meine Perl-Artikel · perldev – verschiedene Perl-Versionen unter Windows starten
    - guest curupira
      
      2013-07-26 15:11
      
      As you could deduce from my answer, I put the right utf8.
      Last edited: 2013-07-26 15:16:09 +0200 (CEST)
    - lichtkind
      
      2013-07-26 15:35
      
      User since
      2004-03-22
      5709 articles
      ModeratorIn + EditorIn
      
      jup mein fehler, was in a hurry
      Tutorien in der Wiki, mein zeug:
      kephra, baumhaus, garten, gezwitscher
      
      Es beginnt immer mit einer Entscheidung.
- guest curupira
  
  2013-07-26 16:11
  OK. Found it. thanks for the hint on devel::peek. the UTF8-flag was missing at my variables. so
  
  Code: (dl )
  
  1 2
  
  use Encode; $text=Encode::decode_utf8("ö");
  
  did the trick.
  
  thanks for help.
  Last edited: 2013-07-26 16:13:42 +0200 (CEST)
- payx
  
  2013-07-26 22:45
  
  User since
  2006-05-04
  564 articles
  BenutzerIn
  
  Hi curupira,
  
  Maybe Text::Unidecode could be useful for you.
  
  HTH
  payx

View all threads created 2013-07-26 14:20.