Login
Active Client IP Address & Show the Multiple Client Screen
Client Screen
Server Send to the File
Server Send MSG to Client
Client Receive MSG
Introduction
This project is based on Server and Client System. The primary objective behind development of “Remote Desktop Application” is to provide a mechanism by which System Administrator remotely connects to a desktop machine. It monitors the Client machine and resolves the basic problem for the user.
This project performs the following tasks:
- Views a Desktop remotely
- Handles basic problem form Client
- Handles all controls for Client System
- Server Sent to the file and MSG to Client
Background
One of the biggest challenges in this project is finding a way to move the mouse pointer, simulate key stroke and capture the screen. After spending some time, I found a great Robot
class that does all that I need.
In addition, using serialization to send screenshots from client to server and to send server events like mouse move, key press, key release helped me a lot to write clean and simple code instead of sending images and events in raw data format over the network.
Program Parts
1. RemoteServer
This is the server part which waits for clients connections and per each connected client, a new frame appears showing the current client screen. When you move the mouse over the frame, this results in moving the mouse at the client side. The same happens when you right/left click mouse button or type a key while the frame is in focus.
2. RemoteClient
This is the client side, its core function is sending a screen shot of the client's desktop every predefined amount of time. Also it receives server commands such as "move the mouse command", then executes the command at the client's PC.
Using the Code
In order to run the program, you need to download RemoteServer_source.zip and RemoteClient_source.zip on two different PCs, then extract them. In one of the PCs say PC1, run RemoteServer.jar which is located under dist folder using the following command:
>> java -jar RemoteServer.jar
You will be asked to enter port number for the server to listen at, enter any port number above 1024, for example 5000.
On the other PC say PC2, execute RemoteClient.jar using the following command:
>> java -jar RemoteClient.jar
You will be asked to enter server IP, enter IP address of PC1, then you will be asked to enter port number, enter the same port you entered above, e.g. 5000.
Now, in PC1, you have full control over PC2 including moving the mouse, clicking the mouse, keys stroking, viewing PC2 desktop, etc.
Coding Structure
RemoteServer
ServerInitiator Class
This is the entry class which listens to server port and wait for clients connections. Also, it creates an essential part of the program GUI.
ClientHandler Class
Per each connected client, there is an object of this class. It shows an InternalFrame
per client and it receives clients' screen dimension.
ClientScreenReciever Class
Receives captured screen from the client, then displays it.
ClientCommandsSender Class
It listens to the server commands, then sends them to the client. Server commands include mouse move, key stroke, mouse click, etc.
EnumCommands Class
Defines constants which are used to represent server commands.
RemoteClient
ClientInitiator Class
This is the entry class that starts the client instance. It establishes connection to the server and creates the client GUI.
ScreenSpyer Class
Captures screen periodically and sends them to the server.
ServerDelegate Class
Receives server commands and executes them in the client PC.
EnumCommands Class
Defines constants which are used to represent server commands.
Code Snippets
1) RemoteClient
Connect to Server
System.out.println("Connecting to server ..........");
socket = new Socket(ip, port);
System.out.println("Connection Established.");
Capture Desktop Screen then Send it to the Server Periodically
In ScreenSpyer
class, Screen
is captured using createScreenCapture
method in Robot
class and it accepts a Rectangle
object which carries screen dimension. If we try to send image objects directly using serialization, it will fail because it does not implement Serializable
interface. That is why we have to wrap it using the ImageIcon
class as shown below:
while(continueLoop){
BufferedImage image = robot.createScreenCapture(rectangle);
ImageIcon imageIcon = new ImageIcon(image);
try {
System.out.println("before sending image");
oos.writeObject(imageIcon);
oos.reset();
System.out.println("New screenshot sent");
} catch (IOException ex) {
ex.printStackTrace();
}
try{
Thread.sleep(100);
}catch(InterruptedException e){
e.printStackTrace();
}
}
Receive Server Events, then call Robot Class Methods to Execute these Events
while(continueLoop){
System.out.println("Waiting for command");
int command = scanner.nextInt();
System.out.println("New command: " + command);
switch(command){
case -1:
robot.mousePress(scanner.nextInt());
break;
case -2:
robot.mouseRelease(scanner.nextInt());
break;
case -3:
robot.keyPress(scanner.nextInt());
break;
case -4:
robot.keyRelease(scanner.nextInt());
break;
case -5:
robot.mouseMove(scanner.nextInt(), scanner.nextInt());
break;
}
}
2) RemoteServer
Wait for Clients Connections
while(true){
Socket client = sc.accept();
System.out.println("New client Connected to the server");
new ClientHandler(client,desktop);
}
Receive Client Desktop Screenshots and Display them
while(continueLoop){
ImageIcon imageIcon = (ImageIcon) cObjectInputStream.readObject();
System.out.println("New image received");
Image image = imageIcon.getImage();
image = image.getScaledInstance
(cPanel.getWidth(),cPanel.getHeight(),Image.SCALE_FAST);
Graphics graphics = cPanel.getGraphics();
graphics.drawImage(image, 0, 0, cPanel.getWidth(),cPanel.getHeight(),cPanel);
}
Handle Mouse and Key Events then Send them to the Client Program to Simulate them
In ClientCommandsSender
class, when mouse is moved, x and y values are sent to the client but we have to take into consideration the size difference between clients' screen size and server's panel size, that is why we have to multiply by a certain factor as shown in the following code:
public void mouseMoved(MouseEvent e) {
double xScale = clientScreenDim.getWidth()/cPanel.getWidth();
System.out.println("xScale: " + xScale);
double yScale = clientScreenDim.getHeight()/cPanel.getHeight();
System.out.println("yScale: " + yScale);
System.out.println("Mouse Moved");
writer.println(EnumCommands.MOVE_MOUSE.getAbbrev());
writer.println((int)(e.getX() * xScale));
writer.println((int)(e.getY() * yScale));
writer.flush();
}
public void mousePressed(MouseEvent e) {
System.out.println("Mouse Pressed");
writer.println(EnumCommands.PRESS_MOUSE.getAbbrev());
int button = e.getButton();
int xButton = 16;
if (button == 3) {
xButton = 4;
}
writer.println(xButton);
writer.flush();
}
public void mouseReleased(MouseEvent e) {
System.out.println("Mouse Released");
writer.println(EnumCommands.RELEASE_MOUSE.getAbbrev());
int button = e.getButton();
int xButton = 16;
if (button == 3) {
xButton = 4;
}
writer.println(xButton);
writer.flush();
}
public void keyPressed(KeyEvent e) {
System.out.println("Key Pressed");
writer.println(EnumCommands.PRESS_KEY.getAbbrev());
writer.println(e.getKeyCode());
writer.flush();
}
public void keyReleased(KeyEvent e) {
System.out.println("Mouse Released");
writer.println(EnumCommands.RELEASE_KEY.getAbbrev());
writer.println(e.getKeyCode());
writer.flush();
}
Points of Interest
- Remote Access Methodology: We can access a client system through a server for which we will use Java networking.
- Searching for Active User: We will search the whole network for the system running our client application par.
- Getting access to all available user: Get connected to the users who are running client application part to perform the desire task.
- Sharing Views: In this module, the server is shared throughout the active users.
- Sharing File: File can be shared throughout the active users.