Hello,

I need your help in automating Java application running on web browser and use Java webswing and canvas as I can't get the selector of elements in this application and in inspector I can only hover on the top panel not the elements.

Hint **Java webswing can be found throw this link
Webswing

------------------------------
[ahmed] [shaheen]
[System developer]
[valleysoft-eg]
[Cairo] [Egypt]
[+20-01015699307]
------------------------------

Hi Ahmed,

I was not able to use the recorder with it either.  This may be down to an old Java version on which Webswing runs (Java 8), or a limitation of Webswing itself.   You could try running Webswing on a later version of Java (I think Java 11 is supported).  If that does not work you may have to resort to running your Java Swing app directly on the PC rather than within WebSwing.

------------------------------
NIGEL CROWTHER
------------------------------

Webswing uses a html canvas to draw onto, therefore there are not semantic html tags where the bot can read and find controls. You can think of canvas as actually a drawing surface. In this case, I think you might have to rely on surface automation, using images and locate them.

• https://www.ibm.com/docs/en/rpa/21.0?topic=ocr-in-rpa-studio
• https://www.ibm.com/docs/en/rpa/21.0?topic=guidelines-computer-vision

------------------------------
Joba Diniz
Product Manager
IBM
------------------------------

Thanks , NIGEL CROWTHER  and Joba Diniz ,but running Java Swing app directly on the PC rather than within WebSwing and  using OCR are not accepted to use with the application that we try to automate .

------------------------------
[ahmed] [shaheen]
[System developer]
[valleysoft-eg]
[Cairo] [Egypt]
[+20-01015699307]
------------------------------

Automation uses the underlying UI technology to integrate with applications. In the case of web applications, automation uses the html to understand what is in the page.
As I mentioned, webswing draws onto a canvas (a drawing board), there's nothing in the html about controls because the controls you see were drawn. The only thing we know is that it's a canvas. The only way to automate such applications is by using surface automation.



------------------------------
Joba Diniz
Product Manager
IBM
------------------------------

Original Message:
Sent: Mon July 12, 2021 06:06 PM
From: Ahmed Shaheen
Subject: How to Automate Java Application use Webswing

Thanks , NIGEL CROWTHER  and Joba Diniz ,but running Java Swing app directly on the PC rather than within WebSwing and  using OCR are not accepted to use with the application that we try to automate .

------------------------------
[ahmed] [shaheen]
[System developer]
[valleysoft-eg]
[Cairo] [Egypt]
[+20-01015699307]
------------------------------