IronPython

Closed Issue: long type should support ToString(format) overload

dinov — Fri, 26 Jun 2009 21:10:38 GMT

Concerns: IronPython 1.0.60816 on .NET 2.0.50727.832

The long type does not support the ToString(format) overload so one cannot reliably use, for example, ToString("N0") given a numeric type and that the clr module has been previously imported. It works over int and float but not long. Here's a snippet to demonstrate this:

>>> import clr
>>> for n in (1234, 1234.0, 1234L):
... print type(n), n.ToString("N0")
...
<type 'int'> 1,234
<type 'float'> 1,234
<type 'long'>Traceback (most recent call last):
File , line 0, in <stdin>##56
TypeError: no overloads of ToString could match (long, str)
ToString(long, UInt32)
ToString(long, IFormatProvider)
Comments: Ported to DLR bug database: http://dlr.codeplex.com/WorkItem/View.aspx?WorkItemId=3360

Commented Issue: Implement time.tzset

dinov — Fri, 26 Jun 2009 21:05:26 GMT

We need this to properly test the effects of changing timezones on various functions in the time module. Among other things, this is needed to enable a regression in CPy's test_time.py for http://ironpython.codeplex.com/WorkItem/View.aspx?WorkItemId=19130.
Comments: This doesn't exist on Windows for CPython - not sure if we can implement it.

Closed Issue: Import don't work in ToyScript Console

dinov — Fri, 26 Jun 2009 20:36:28 GMT

The Import command don't work in the ToyScript Console. Here is a "screen capture":

ToyScript Console.
Let's Play ...

Toy > import System
Toy > dt = System.DateTime
System.MissingMemberException: DateTime
à _stub_$3##3(Closure , CallSite , CodeContext , Object )
à _stub_MatchCaller(Object , CallSite , Object[] )
à Microsoft.Scripting.Actions.CallSite`1.UpdateAndExecute(Object[] args) dans
D:\users\LASKE\Desktop\Langages\IronPython-2.0B3\Src\Microsoft.Scripting.Core\A
ctions\CallSite.cs:ligne 297
à Microsoft.Scripting.Actions.UpdateDelegates.Update2[T,T0,T1,TRet](CallSite
site, T0 arg0, T1 arg1) dans D:\users\LASKE\Desktop\Langages\IronPython-2.0B3\Sr
c\Microsoft.Scripting.Core\Actions\UpdateDelegates.Generated.cs:ligne 34
à Initialize$2##2(Closure , CodeContext )
à Microsoft.Scripting.ScriptCode.Run(CodeContext context) dans D:\users\LASKE
\Desktop\Langages\IronPython-2.0B3\Src\Microsoft.Scripting.Core\Runtime\ScriptCo
de.cs:ligne 122
à Microsoft.Scripting.ScriptCode.Run(Scope scope) dans D:\users\LASKE\Desktop
\Langages\IronPython-2.0B3\Src\Microsoft.Scripting.Core\Runtime\ScriptCode.cs:li
gne 111
à Microsoft.Scripting.Hosting.Shell.CommandLine.ExecuteCommand(SourceUnit sou
rce) dans D:\users\LASKE\Desktop\Langages\IronPython-2.0B3\Src\Microsoft.Scripti
ng\Hosting\Shell\CommandLine.cs:ligne 259
à Microsoft.Scripting.Hosting.Shell.CommandLine.RunOneInteraction() dans D:\u
sers\LASKE\Desktop\Langages\IronPython-2.0B3\Src\Microsoft.Scripting\Hosting\She
ll\CommandLine.cs:ligne 254
à Microsoft.Scripting.Hosting.Shell.CommandLine.TryInteractiveAction() dans D
:\users\LASKE\Desktop\Langages\IronPython-2.0B3\Src\Microsoft.Scripting\Hosting\
Shell\CommandLine.cs:ligne 220
à Microsoft.Scripting.Hosting.Shell.CommandLine.RunInteractiveLoop() dans D:\
users\LASKE\Desktop\Langages\IronPython-2.0B3\Src\Microsoft.Scripting\Hosting\Sh
ell\CommandLine.cs:ligne 189

Toy >

By the way the same sequence of commands works in a script file (test.ts for example).
Of course, it's not very important that the Import command doesn't work in ToyScript but I've got the same error in my own language (MyJScript). I guess it could be related to the "LanguageContext.DomainManager.Globals.TryGetName" method.

Any help will be appreciated.
Comments: ToyScript no longer is distributed and has been replaced by sympl

Commented Issue: Add locking to import - make imp.lock_lock/acquire_lock/release_lock meaningful, tied to import locking.

dinov — Fri, 26 Jun 2009 20:16:24 GMT

Add locking to import - make imp.lock_lock/acquire_lock/release_lock meaningful, tied to import locking.
Comments: ** Comment from web user: dinov **

Closed Issue: Importer does not lock

dinov — Fri, 26 Jun 2009 20:16:11 GMT

<Test>test_threaded_import.py (CPy)</Test>

Shown below are 2 example failures. CPython's test_threaded_import.py seems to pass fairly reliably when run normally (first repro is one rare exception). However, it seems to fail reliably using ipy.bat (second repro).

Test is currently disabled in SNAP (Suites/Checkin/Languages/IP/2.X/cpy/12) and should be reenabled when this is fixed.

----------------------------------------

%> ipyd test\test_threaded_import.py
Trying 20 threads ... Unhandled exception on thread
Traceback (most recent call last):
File "test\test_threaded_import.py", line 16, in task
File "C:\vsl0\Merlin\External.LCA_RESTRICTED\Languages\IronPython\26\Lib\random.py", line 42,
in C:\vsl0\Merlin\External.LCA_RESTRICTED\Languages\IronPython\26\Lib\random.py
ImportError: Cannot import name division
Traceback (most recent call last):
File "test\test_threaded_import.py", line 75, in test\test_threaded_import.py
File "test\test_threaded_import.py", line 67, in test_main
File "mscorlib", line unknown, in Invoke
File "mscorlib", line unknown, in Invoke
File "mscorlib", line unknown, in Invoke
File "mscorlib", line unknown, in InvokeMethodFast
File "mscorlib", line unknown, in _InvokeMethodFast
KeyboardInterrupt^C

----------------------------------------
%>%merlin_root%\languages\ironpython\internal\ipy.bat Test\test_threaded_import.py
x86
Microsoft Windows [Version 6.1.7000]
Trying 20 threads ... Unhandled exception on threadUnhandled exception on thread
Unhandled exception on thread
Unhandled exception on thread

Traceback (most recent call last):
File "Test\test_threaded_import.py", line 17, in task
AttributeError: 'module' object has no attribute 'randrange'
Traceback (most recent call last):
File "Test\test_threaded_import.py", line 17, in task
AttributeError: 'module' object has no attribute 'randrange'
Traceback (most recent call last):
File "Test\test_threaded_import.py", line 17, in task
AttributeError: 'module' object has no attribute 'randrange'Traceback (most recent call last):
File "Test\test_threaded_import.py", line 17, in task
AttributeError: 'module' object has no attribute 'randrange'

Traceback (most recent call last):
File "Test\test_threaded_import.py", line 75, in __main__
File "Test\test_threaded_import.py", line 67, in test_main
File "mscorlib", line unknown, in WaitOne
File "mscorlib", line unknown, in WaitOne
File "mscorlib", line unknown, in WaitOne
File "mscorlib", line unknown, in WaitOneNative
KeyboardInterruptTerminate batch job (Y/N)? y
Comments:

dup of 19091

Commented Issue: Bug with AttributeError raised in get

dinov — Fri, 26 Jun 2009 20:10:03 GMT

The real exception is being hidden, and a false one being raised. Use the attached file to replicate.

C:\Projects\Prototypes\attr_error_bug>python noattr.py
Traceback (most recent call last):
File "noattr.py", line 39, in <module>
print f.bar
File "noattr.py", line 17, in __get__
v = self.fget(obj)
File "noattr.py", line 32, in bar
return self._attr_error();
File "noattr.py", line 35, in _attr_error
return types.FunctionTyp
AttributeError: 'module' object has no attribute 'FunctionTyp'

C:\Projects\Prototypes\attr_error_bug>ipy noattr.py
Traceback (most recent call last):
File "noattr.py", line 39, in noattr.py
AttributeError: 'Foo' object has no attribute 'bar'
Comments: Fixed, test case added in test_class: test_descriptor_exception

Commented Issue: import thread-safety

dinov — Fri, 26 Jun 2009 20:02:38 GMT

CLS Exception: System.InvalidOperationException: Collection was
modified; enumeration operation may not execute.

when importing

see the thread on ironpython list, it has the traceback and a fix

http://groups.google.com/group/ironpy/browse_thread/thread/45c62fe04a91a128#
Comments: This was fixed a while ago - we were just missing a lock statement in StoreOverridenMethod.

Commented Issue: dir has missing items for classes subclassing both old- and new- style classes

dinov — Fri, 26 Jun 2009 19:56:30 GMT

class A:
a = 1
class B(object):
b = 2
class C(A,B):
pass
class D(A, B):
pass

dir(C) and dir(D) contain 'b' but not 'a'. This occur is build 43873 as well as the release candidate for IronPython 2.0.

Thank you,
Tom (tom.wrigth@resolversystems.com)
Comments: This is fixed (and is a dup of another bug)

Commented Feature: Implement repr for enums

dinov — Fri, 26 Jun 2009 17:55:52 GMT

Enums can include a __repr__ which includes their fully qualified namespace, typename, and value. For example currently the repr of Color.Red is:

<System.Drawing.Color object at 0x000000000000002C [Color [Red]]>

it could be:

System.Drawing.Color.Red

instead. This works for non-flags values. For flags values we could attempt to calculate the flags or return a <> repr w/ the integer value.
Comments: ** Comment from web user: dinov **

Note color is not actually an enum type so it's a bad example here.

Commented Feature: Expose SystemState via hosting API

dinov — Fri, 26 Jun 2009 17:43:10 GMT

Changing the default encoding requires doing engine.Execute("sys.setdefaultencoding('utf_16_le')"). Instead this could be exposed directly via the hosting API.

<Thanks>Kristof Wagemans</Thanks>
Comments: ** Comment from web user: dinov **

This has been exposed since 2.0 as engine.GetSysModule(). You can now do:

engine.Operations.Invoke(engine.GetSysModule().GetVariable("setdefaultencoding"), "utf_16_le");

Commented Feature: Pickling System.DateTime instance error

dinov — Fri, 26 Jun 2009 17:40:19 GMT

It's possible that this may be an "as designed" issue but the following code throws an exception and I'm guessing that it shouldn't. The experience is the same for 1.0 and 1.1 releases on .NET 2.0.50727.312 (Vista x64).

>>> import System
>>> import cPickle
>>> t = System.DateTime.Now
>>> cPickle.dumps(t)
Traceback (most recent call last):
File , line 0, in <stdin>##34
File , line 0, in DumpToString##17
File , line 0, in NonDefaultNew##25
File , line 0, in .ctor##27
TypeError: Cannot convert DateTime(5/3/2007 9:37:37 AM) to Int64

Regards
Comments: ** Comment from web user: dinov **

This was fixed in 2.0 w/ our minimal pickle/serialization interop support.

Commented Feature: Add way to disable assembly resolve event

dinov — Fri, 26 Jun 2009 17:38:59 GMT

<Thanks>Jeff Brown</Thanks>

Iron Python installs a rather dragonic AssemblyResolve hook. It uses Assembly.LoadFile to try to load an Assembly from the path when resolution fails. I would prefer if Assembly.LoadFrom were provided at least as an option, if not just made the standard behavior (once again).

The problem in my case is that Iron Python is linking to an application that installs its own AssemblyResolve hook based on LoadFrom. Because LoadFrom and LoadFile Assemblies are tracked separately it happens that two copies of the same Assembly are loaded but they have incompatible types so the application blows up. What's more, there may actually be several identical copies of the same assembly floating around the search path. This is because the application consists of an assortment of plugin folders with locally copied (rather than shared) binaries.

Here's my current workaround. Ugly huh?
Comments: ** Comment from web user: dinov **

Fixed a while ago - we now support a NoAssemblyResolveHook option.

Closed Feature: CPython has nt.dup, nt.dup2, nt.execv,nt.execve functions while IP does not have

dinov — Fri, 26 Jun 2009 17:38:04 GMT

CPython has nt.dup, nt.dup2, nt.execv,nt.execve functions while IP does not implement them.
Comments:

really closing as dup

Commented Feature: Implement standard python encodings

dinov — Fri, 26 Jun 2009 17:37:11 GMT

Implement standard python encodings like rot13, base64,hex,uu etc
Comments: ** Comment from web user: dinov **

We are now just missing some of the multi-byte encodings.

Commented Feature: Support type inference on generic methods and improve function conversions - better LINQ support

dinov — Fri, 26 Jun 2009 17:36:46 GMT

This is generally to improve the LINQ support. Currently the LINQ extension methods are difficult to call directly. And when overloads are involved Python functions don't get passed very easily.
Comments: ** Comment from web user: dinov **

Implemented for 2.6 beta 2

Commented Feature: Implement _ctypes module

dinov — Fri, 26 Jun 2009 17:35:42 GMT

<Thanks>Quantum Infinity</Thanks><OpenBuild>1.0 Beta 6</OpenBuild>

4/27/2006 3:30 PM Opened by dinov
Hi All,

This is my first post here and I hope this question was not asked before.

Anyway, is there any way to call a Win32 API in IronPython? I was trying to
search Google along the lines of DllImport and DLLImportAttribute but I
could not find and working example. I also tried to use the samples from Boo
but I couldn't make it to work in IronPython.

In CPython, i can use CTypes and call Win32 API but I just am really lost
with IronPython.
6/9/2006 10:30 AM Edited by sborde
This is currently planned to be fixed shortly after 1.0. We need to prioritize bugs for the 1.0 release. If this seems to be an important issue that you would like to see fixed in 1.0, please let us know.
Comments: ** Comment from web user: dinov **

This has now been implemented - there still remain some bugs and a little feature work remaining.

Commented Issue: dir(System.ArgIterator) broken

dinov — Fri, 26 Jun 2009 17:14:38 GMT

<Test>system_namespaces.py</Test>

IP VERSION AFFECTED: 2.0B3
FLAGS PASSED TO IPY.EXE: Any
OPERATING SYSTEM: All

DESCRIPTION:
Looks like a COR_E_BADIMAGEFORMAT exception is thrown when one tries to dir the System.ArgIterator type.

REPRODUCTION SNIPPET:
E:\vsl2\Merlin\Main\Languages\IronPython\Tests>ipyd
IronPython 2.0 Beta (2.0.0.3000) on .NET 2.0.50727.3031
Copyright (c) Microsoft Corporation. All rights reserved.
>>> import System
>>> System.ArgIterator
<type 'ArgIterator'>
>>> dir(System.ArgIterator)
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
SystemError: An attempt was made to load a program with an incorrect format. (Exception from HRESULT: 0x8007000B)
>>>
Comments: ** Comment from web user: dinov **

Fix backported to 2.0.2

Commented Issue: Trivial: os.walk('') dosn't work

dinov — Fri, 26 Jun 2009 17:14:32 GMT

The following code works fine with CPython 2.5.2 and 2.6.1,
but causes ValueError in IronPython 2.0.

import os
for root, files, dirs in os.walk(""):
for f in files:
print os.path.join(root, f)
Comments: ** Comment from web user: dinov **

Fix backported to 2.0.2

Commented Issue: os.listdir does not accept empty path

dinov — Fri, 26 Jun 2009 17:14:06 GMT

An empty string passed into os.listdir(), lists the contents of the current working directory in Python 2.6.

In IronPython 2.0.1 an exception is generated:
IronPython 2.0 (2.0.0.0) on .NET 2.0.50727.3053
Type "help", "copyright", "credits" or "license" for more information.
>>> import os
>>> os.listdir('')
Traceback (most recent call last):
File "mscorlib", line unknown, in GetFiles
File "mscorlib", line unknown, in InternalGetFileDirectoryNames
File "mscorlib", line unknown, in GetFullPathInternal
File "mscorlib", line unknown, in NormalizePath
File "mscorlib", line unknown, in NormalizePathFast
File "<stdin>", line 1, in <module>
ValueError: The path is not of a legal form.
>>>

-- Marcel
Comments: ** Comment from web user: dinov **

Fix backported to 2.0.2

Commented Issue: Support all encodings CPython does for _codecs.encode and _codecs.decode

dinov — Fri, 26 Jun 2009 17:13:54 GMT

<Test>test_codecs.py</Test>

Under CPython:
>>> _codecs.encode("abc")
'abc'
>>> _codecs.decode("abc")
u'abc'

Under IronPython:
>>> _codecs.encode("abc")
Traceback (most recent call last):
File , line 0, in <stdin>##26
LookupError: unknown encoding: us_ascii
>>> _codecs.decode("abc")
Traceback (most recent call last):
File , line 0, in <stdin>##27
LookupError: unknown encoding: us_ascii
Comments: ** Comment from web user: dinov **

Fix Backported to 2.0.2

IronPython

Closed Issue: long type should support ToString(format) overload

Commented Issue: Implement time.tzset

Closed Issue: Import don't work in ToyScript Console

Commented Issue: Add locking to import - make imp.lock_lock/acquire_lock/release_lock meaningful, tied to import locking.

Closed Issue: Importer does not lock

Commented Issue: Bug with AttributeError raised in __get__

Commented Issue: import thread-safety

Commented Issue: dir has missing items for classes subclassing both old- and new- style classes

Commented Feature: Implement __repr__ for enums

Commented Feature: Expose SystemState via hosting API

Commented Feature: Pickling System.DateTime instance error

Commented Feature: Add way to disable assembly resolve event

Closed Feature: CPython has nt.dup, nt.dup2, nt.execv,nt.execve functions while IP does not have

Commented Feature: Implement standard python encodings

Commented Feature: Support type inference on generic methods and improve function conversions - better LINQ support

Commented Feature: Implement _ctypes module

Commented Issue: dir(System.ArgIterator) broken

Commented Issue: Trivial: os.walk('') dosn't work

Commented Issue: os.listdir does not accept empty path

Commented Issue: Support all encodings CPython does for _codecs.encode and _codecs.decode

Commented Issue: Bug with AttributeError raised in get

Commented Feature: Implement repr for enums