[Mono-dev] Re: [Mono-devel-list] mcs patch for default encoding

[Atsushi Eno]

Hi Marek,

Marek Safar wrote:
> Hello Eno,
> 
>> Any comments on this patch? If we leave this problem as is, most
>> of native-language dependent applications won't compile fine
>> (as I experienced on many Japanese sources).
>>  
>>
> Probably, we will have to fix this bug first.
> 
> http://bugzilla.ximian.com/show_bug.cgi?id=73086

Agreed. In fact, I was also fixing bug #75065, maybe duplicate.
I have a fix for UTF8Encoding, but it uncovered another mcs bug
which does not handle files with BOM with specific encoding.
To summarize the situation:

	- Currently driver.cs does not process source files with
	  default encoding.
	- UTF8Encoding.cs does not handle U+FEFF correctly.
	- When we fix UTF8Encoding.cs to handle U+FEFF, it starts
	  to reject some source files which has BOM.
	  (CS8025:Parsing error)
	- Even if we fix driver.cs to let StreamReader consider BOM
	  (currently we disable it), there are still some files
	  borking.

Am digging into this bug in depth. Hopefully I'll post a set of
fixes later.

Atsushi Eno