HTTPError in android but not dev

[bompaization]

Hi, first time trying beeware, I'm attempting to write an app to display solar inverter output.
In briefcase dev it works fine, but when I build the apk I get this error:

03-05 15:00:40.531 4681 4681 E AndroidRuntime: Caused by: com.chaquo.python.PyException: HTTPError: 403 Client Error: Forbidden for url: https://server-api.growatt.com/newTwoLoginAPI.do

[mhsmith]

Maybe your code depends on a file in your development environment, which is available when running briefcase dev, but not on Android.

Do you have control over the server? If so, you might find a more detailed error message in its log files.

Even if you don't have control of the server, there's a pretty good chance that the HTTP response contains an explanation of what's wrong.
For example, if I visit that URL myself, it returns a 400 error page saying there's a missing "op" parameter. So try editing your code to catch the error, and either display the response body on the screen, or print it to stdout.

[bompaization]

There is only one module that I import, and it works in both dev and android env - otherwise the app wouldn't get to that point.
I have no control over the server.
I'm still confounded why it would work in dev and not in android.

[bompaization]

I installed a web debugger and noticed that nothing was sent to the server while running the android briefcase.
Is there a dependency that i need to include?

[freakboy3742]

If the web view wasn't making a request, it wouldn't be retuning a 403 error, so something else is going on here. However, It's very difficult to diagnose what is going wrong when we know almost nothing about the app that is causing the error. A minimal reproduction case would help to clarify - and the process of building that minimal reproduction case may clarify your own understanding of the source of the problem.

[bompaization]

I think i've isolated the problem. Somewhere along the line I made a change to the imported module and somehow python/beeware persistently uses a cached version when making the android build. That's probably why the dev version doesn't produce an error.

[mhsmith]

We might make this automatic in the future, but you currently need to pass the -u option to briefcase run to make it pick up any changes to your source code.

[bompaization]

Collecting growattServer Using cached growattServer-1.4.0-py3-none-any.whl (11 kB)
this is the culprit, I don't know how to stop the build from re-using this cache

[mhsmith]

How are you using a local version? Have you copied it into your app's src directory? If so, it should take priority over anything directly or indirectly installed through the requires list, so perhaps that isn't the problem at all.

You can check where a module comes from at runtime by seeing whether its __file__ attribute contains "app" or "requirements".

[bompaization]

Yes I copied it in the app's src. When I print the __file__ attribute, in briefcase dev it displays the app directory and all is well, but in the android run it displays the "requirements" directory, like so:
python.stdout: Module path: /data/data/com.example.gromon3/files/chaquopy/AssetFinder/requirements/growattServer/__init__.py

[mhsmith]

So you have a growattServer directory directly underneath your src directory, right?

I'm not sure whether you expect growattServer to still be installed via requires. Did you previously have it in the requires list, or do you have something else in the list that might depend on it?

When you run briefcase run, you'll need to include the -u option to pick up changes to your source code, and -r for changes to your requires list. Are you sure you included them both?

[bompaization]

Yes, the growattServer directory is in the src directory.
Do you mean that I need to remove growattServer from requires in pyproject.toml ? Because if I do that, I get the ModuleNotFoundError error.
I'm sure I'm doing something wrong that may seem obvious to you, but as I said, I'm just starting out.

[mhsmith]

Please post the complete ModuleNotFoundError, including the stack trace.

[bompaization]

--------- beginning of main
03-08 14:46:45.789  9099  9099 I example.gromon: Late-enabling -Xcheck:jni
03-08 14:46:45.941  9099  9099 W example.gromon: Unexpected CPU variant for X86 using defaults: x86_64
03-08 14:46:46.019  9099  9099 D CompatibilityChangeReporter: Compat change id reported: 171979766; UID 10108; state: ENABLED
03-08 14:46:46.196  9099  9099 V GraphicsEnvironment: ANGLE Developer option for 'com.example.gromon3' set to: 'default'
03-08 14:46:46.196  9099  9099 V GraphicsEnvironment: Neither updatable production driver nor prerelease driver is supported.
03-08 14:46:46.200  9099  9099 D NetworkSecurityConfig: Using Network Security Config from resource network_security_config debugBuild: true
03-08 14:46:46.205  9099  9099 D NetworkSecurityConfig: Using Network Security Config from resource network_security_config debugBuild: true
03-08 14:46:46.280  9099  9125 D libEGL  : loaded /vendor/lib64/egl/libEGL_emulation.so
03-08 14:46:46.282  9099  9125 D libEGL  : loaded /vendor/lib64/egl/libGLESv1_CM_emulation.so
03-08 14:46:46.285  9099  9099 D MainActivity: onCreate() start
03-08 14:46:46.285  9099  9125 D libEGL  : loaded /vendor/lib64/egl/libGLESv2_emulation.so
03-08 14:46:46.405  9099  9099 W example.gromon: Accessing hidden method Landroid/view/View;->computeFitSystemWindows(Landroid/graphics/Rect;Landroid/graphics/Rect;)Z (unsupported, reflection, allowed)
03-08 14:46:46.406  9099  9099 W example.gromon: Accessing hidden method Landroid/view/ViewGroup;->makeOptionalFitsSystemWindows()V (unsupported, reflection, allowed)
03-08 14:46:46.416  9099  9099 D MainActivity: Starting Python
03-08 14:46:46.500  9099  9133 W native.stderr: Could not find platform independent libraries <prefix>
03-08 14:46:46.500  9099  9133 W native.stderr: Could not find platform dependent libraries <exec_prefix>
03-08 14:46:46.513  9099  9099 W example.gromon3: type=1400 audit(0.0:1701): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/zlib.so" dev="dm-5" ino=123506 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:46.645  9099  9099 W example.gromon3: type=1400 audit(0.0:1702): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/java/chaquopy.so" dev="dm-5" ino=123497 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:46.673  9099  9099 W example.gromon3: type=1400 audit(0.0:1703): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/_ctypes.so" dev="dm-5" ino=123501 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:46.681  9099  9099 W example.gromon3: type=1400 audit(0.0:1704): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/_struct.so" dev="dm-5" ino=123494 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:46.773  9099  9099 W example.gromon3: type=1400 audit(0.0:1705): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/math.so" dev="dm-5" ino=123499 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:46.781  9099  9099 W example.gromon3: type=1400 audit(0.0:1706): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/_datetime.so" dev="dm-5" ino=123505 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:46.977  9099  9099 W example.gromon3: type=1400 audit(0.0:1707): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/_random.so" dev="dm-5" ino=123503 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:46.977  9099  9099 W example.gromon3: type=1400 audit(0.0:1708): avc: granted { execute } for path="/data/data/com.example.gromon3/files/chaquopy/bootstrap-native/x86_64/_sha512.so" dev="dm-5" ino=123504 scontext=u:r:untrusted_app:s0:c108,c256,c512,c768 tcontext=u:object_r:app_data_file:s0:c108,c256,c512,c768 tclass=file app=com.example.gromon3
03-08 14:46:47.214  9099  9099 W asset   : seek out of range: want -20, end=22
03-08 14:46:47.414  9099  9099 D MainActivity: Running main module gromon3
03-08 14:46:47.637  9099  9099 D AndroidRuntime: Shutting down VM
--------- beginning of crash
03-08 14:46:47.638  9099  9099 E AndroidRuntime: FATAL EXCEPTION: main
03-08 14:46:47.638  9099  9099 E AndroidRuntime: Process: com.example.gromon3, PID: 9099
03-08 14:46:47.638  9099  9099 E AndroidRuntime: java.lang.RuntimeException: Unable to start activity ComponentInfo{com.example.gromon3/org.beeware.android.MainActivity}: com.chaquo.python.PyException: ModuleNotFoundError: No module named 'growattServer'
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.ActivityThread.performLaunchActivity(ActivityThread.java:3635)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.ActivityThread.handleLaunchActivity(ActivityThread.java:3792)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.servertransaction.LaunchActivityItem.execute(LaunchActivityItem.java:103)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.servertransaction.TransactionExecutor.executeCallbacks(TransactionExecutor.java:135)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.servertransaction.TransactionExecutor.execute(TransactionExecutor.java:95)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.ActivityThread$H.handleMessage(ActivityThread.java:2210)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.os.Handler.dispatchMessage(Handler.java:106)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.os.Looper.loopOnce(Looper.java:201)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.os.Looper.loop(Looper.java:288)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.ActivityThread.main(ActivityThread.java:7839)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at java.lang.reflect.Method.invoke(Native Method)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:548)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1003)
03-08 14:46:47.638  9099  9099 E AndroidRuntime: Caused by: com.chaquo.python.PyException: ModuleNotFoundError: No module named 'growattServer'
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.java.chaquopy.import_override(import.pxi:20)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.java.chaquopy.import_override(import.pxi:60)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.gromon3.app.<module>(app.py:8)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.java.chaquopy.import_override(import.pxi:60)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.__main__.<module>(__main__.py:1)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.runpy._run_code(<frozen runpy>:88)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.runpy._run_module_code(<frozen runpy>:98)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.runpy.run_module(<frozen runpy>:226)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.chaquopy_java.call(chaquopy_java.pyx:354)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at <python>.chaquopy_java.Java_com_chaquo_python_PyObject_callAttrThrowsNative(chaquopy_java.pyx:326)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at com.chaquo.python.PyObject.callAttrThrowsNative(Native Method)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at com.chaquo.python.PyObject.callAttrThrows(PyObject.java:232)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at com.chaquo.python.PyObject.callAttr(PyObject.java:221)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at org.beeware.android.MainActivity.onCreate(MainActivity.java:64)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.Activity.performCreate(Activity.java:8051)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.Activity.performCreate(Activity.java:8031)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.Instrumentation.callActivityOnCreate(Instrumentation.java:1329)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        at android.app.ActivityThread.performLaunchActivity(ActivityThread.java:3608)
03-08 14:46:47.638  9099  9099 E AndroidRuntime:        ... 12 more
03-08 14:46:47.674  9099  9099 I Process : Sending signal. PID: 9099 SIG: 9

[mhsmith]

Are you sure you have growattServer directly underneath your src directory, and not, for example, inside the gromon3 directory?

And does it contain an __init__.py file?

And please confirm that you're passing both -u and -r to the briefcase run command.

[bompaization]

the dir structure is as follows:

beeware-venv
gromon3
---android
---logs
---src
------gromon3
---------__pycache__
---------resources
---------__init__.py
---------__main__.py
---------app.py
------gromon3.dist-info
------growattServer
---------__pycache__
---------__init__.py
---tests
---windows

yes I type briefcase run android -u -r

[mhsmith]

Oh, I know what it must be: you have to add src/growattServer to the sources list in your pyproject.toml file.

[bompaization]

that appears to have done the trick, except now it's another issue:
ModuleNotFoundError: No module named 'requests' It's being called in the growattServer module.
I am running python in a virtual environment, the module is installed and appears in pip list

[mhsmith]

Your Android app won't be able to see the packages in your virtual environment, only the packages in your requires list. In this case, since you're no longer installing growattServer with pip, you'll have to list its requirements manually. You can find them in its setup.py file.