An intelligent assist system having a modular architecture, coordinated by electronic communication links between the modules, is provided. Motion modules provide an assist upon actuation, and are in communication with computational nodes. Communication links between at least two of the computational nodes carry information between the nodes that actuate a motion module.

Inventors: Peshkin; Michael A. (Evanston, IL); Colgate; J. Edward (Evanston, IL); Santos-Munne; Julio (Glenview, IL); Meer; David (Skokie, IL); Lipsey; James (Chicago, IL); Wannasuphoprasit; Witaya (Bangkok, TH); Klostermeyer; Stephen H. (Mt. Prospect, IL)

Assignee: The Stanley Works (New Britain, CT)

Appl. No.: 781683

Filed: February 12, 2001

Current U.S. Class: 700/245; 700/17; 700/83; 700/19; 700/213; 700/249; 700/261; 700/264; 318/568.11; 318/568.16; 318/628; 318/632; 212/330

Intern’l Class: G06F 019/00

Field of Search: 700/1,19-20,17,83,213,230,245,249,258-261,264 318/568.11,568.16,628,632 701/2 706/27 212/330

References Cited [Referenced By]

U.S. Patent Documents

4877940 Oct., 1989 Bangs et al.

5410638 Apr., 1995 Colgate et al.

5523662 Jun., 1996 Goldenberg et al.

5952796 Sep., 1999 Colgate et al.

6282455 Aug., 2001 Engdahl.

6813542 Nov., 2004 Peshkin et al.

2002/0116453 Aug., 2002 Todorov et al.

Foreign Patent Documents

297 19 865 Mar., 1998 DE.

WO 98/4391/1 Oct., 1998 WO.

WO 99/2168/7 May., 1999 WO.

WO 00/4657/0 Aug., 2000 WO.

WO 01/0569/7 Jan., 2001 WO.

International Search Report for PCT/US02/03997.

Primary Examiner: Patel; Ramesh

Attorney, Agent or Firm: Pillsbury Winthrop Shaw Pittman LLP

Claims

1. An intelligent assist system having a modular architecture, comprising:

a motion module for supporting and moving a payload;

a plurality of computational nodes, at least one of the plurality of computational nodes being configured to control the motion module; and

a plurality of communication links, at least one of the plurality of communication links being between two of the plurality of computational nodes to carry information between the nodes to actuate the motion module.

2. The system of claim 1 wherein the motion module comprises a moveable trolley.

3. The system of claim 1 wherein the motion module comprises a lift.

4. The system of claim 1 wherein one of the computational nodes is embedded in the motion module.

5. The system of claim 4 wherein the embedded computational node provides communication between a plurality of modules and controls each of the plurality of modules.

6. The system of claim 5 wherein one of the modules comprises a sensor and the embedded computational node provides communication to the module comprising the sensor.

7. The system of claim 5 wherein one of the modules comprises an actuator and the embedded computational node provides communication to module comprising the actuator.

8. The system of claim 1 wherein the computational nodes comprise a programmable logic device.

9. The system of claim 1 wherein the computational nodes execute motion control algorithms.

10. The system of claim 1 wherein the computational nodes execute automatic motion control algorithms.

11. The system of claim 1 wherein the computational nodes store text messages recallable by an operator.

12. The system of claim 1 wherein the communication links implement the CAN protocol.

13. The system of claim 1 wherein the communication links provide access to an information network.

14. The system of claim 1 wherein the communication links provide access to a local area network.

15. The system of claim 1 wherein the communication links access a wide area network.

16. The system of claim 1 wherein the communication links access the Internet.

17. The system of claim 1 wherein the communication links provide remote access and programming of the assist system.

18. The system of claim 1 further comprising a user tooling supported by the motion module.

19. The system of claim 1 further comprising a skew angle sensor.

20. The system of claim 1 further comprising a lateral position sensor.

21. The system of claim 1 further comprising a vertical position sensor.

22. The system of claim 1 further comprising a user actuator.

23. The system of claim 1 further comprising a hub to allow a user to interface with the computational nodes of the system.

24. The system of claim 23 wherein the hub comprises both mechanical support to a tooling or the payload and computational capability.

25. The system of claim 23 wherein the hub comprises a interface for connection of a intent sensor.

26. The system of claim 23 wherein the hub comprises a interface for connection of a user computer for programming of the system.

27. An intelligent assist system comprising:

an overhead support;

an intelligent assist module constructed and arranged to move a payload, the module being supported by the overhead support;

a plurality of computational nodes, wherein at least one of the computational nodes is on the intelligent assist module and is constructed and arranged to control movement of the intelligent assist module; and

a communication link that connects two of the plurality of computational nodes,

wherein the communication link is configured to carry information between the two computational nodes to actuate the intelligent assist module.

28. A system according to claim 27, wherein the intelligent assist module is a trolley.

29. A system according to claim 27, wherein the module is a lift.

30. A system according to claim 27, further comprising additional communication links that connect the plurality of computational nodes.

Description

FIELD OF INVENTION

The present invention relates to the field of programmable robotic manipulators and assist devices, and in particular, robotic manipulators and assist devices that can interact with human operators.

BACKGROUND OF THE INVENTION

In an industrial application such as a manufacturing assembly line or general material handling situation, the payload may be too large for a human operator to move without mechanical assistance or risking injury. Even with lighter loads it may be desirable to provide a human operator with mechanical assistance in order to allow more rapid movement and assembly, avoid strain, fatigue or repetitive motion injuries. Thus, a great deal of industrial assembly and material handling work is done with the help of assist devices such as x-y overhead rail systems. There are two primary examples of these types of devices: (1) powered overhead gantry cranes for large loads, usually running on I-beams, and (2) unpowered overhead rail systems for smaller loads running on low-friction enclosed rails.

These types of assist devices may be passive devices or active devices. For smaller loads, a passive overhead rail system may be used to assist an operator in supporting the load. The operator may push on the payload directly, causing the trolley and bridge rail to move along with the payload to assist the operator in handling the load.

A number of problems, however, plague unpowered overhead rail systems. Getting the payload moving is not the primary one. This can be done by forward pushing, using the large muscles of the lower body which are not easily injured. Controlling the motion of the moving payload is a greater problem, as it requires pulling sideways with respect to the payload’s direction of motion, generally using the smaller and more easily injured muscles of the upper body and back.

Anisotropy is a further problem. Although low-friction designs are used, both the friction and the inertia are greater in the direction in which the payload has to carry with it the whole bridge rail than in the direction in which the payload simply moves along the bridge rail. Anisotropy produces an unintuitive response of the payload to applied user forces and often results in the user experiencing a continuous sideways “tugging” as the payload moves, in order to keep it on track. Both steering and anisotropy contribute to ergonomic strain, lower productivity, and a changeover to slower gantry cranes at an unnecessarily low payload weight threshold.

Active devices can be used to generate additional forces which an operator can call upon to further assist in supporting or moving a payload. For larger loads, an active motor-driven trolley and bridge rail transport can be used to assist the operator by providing a mechanical assist. Such additional forces can be generated by motors, balancers, hydraulics, etcetera, which can typically be controlled by the operator.

Intelligent Assist Devices (“IADs”) are a class of computer-controlled machines that interact with a human operator to assist in moving a payload. IADs may provide a human operator a variety of types of assistance, including supporting payload weight, helping to overcome friction or other resistive forces, helping to guide and direct the payload motion, or moving the payload without human guidance. The Robotics Industries Association T15 Committee on Safety Standards for Intelligent Assist Devices describes IADs as a single or multiple axis device that employs a hybrid programmable computer-human control system to provide human strength amplification, guiding surfaces, or both. These multifunctional assist devices are designed for material handling, process and assembly tasks that in normal operation involve a human presence in its workspace. Typically, Intelligent Assist Devices (IADs) are force-based control devices that range from single axis payload balancing to multiple degree of freedom articulated manipulators.

IADs may have multiple modes of operation such as a hands-on-controls mode providing a powered motion of the IAD when the human operator is in physical control and contact with the IAD primary controls. In addition, a hands-on-payload mode provides a selectable powered motion of the IAD in response to the operator positively applying forces to the payload or tooling, when the operator’s hand(s) are not on the primary controls. A hands-off mode provides a powered motion of the IAD that is not in response and proportion to forces applied by the operator. Within each of these modes, the IAD may employ features such as force amplification, virtual guiding surfaces, and line tracking technologies.

Because IADs are intended for close interaction with human operators, unambiguous communication of IAD mode of operation to the human operator is particularly important. The man-machine interface should be clearly and ergonomically designed for efficient use of the system and safety of the operator. Ease and intuitiveness of operation is necessary for achieving high levels of productivity. Because of the close interaction of man and machines, safety of the human operator is most important. For example, the IAD mode shall be signaled by a continuous mode indicator that is readily visible to the operator and to other personnel in or near the IAD’s workspace. Furthermore, attention should be paid to the design of the operator’s controls such that inadvertent or mistaken changes of mode are minimized.

Another main objective in developing IADs is to merge the best of passive and active devices. Needed is the powered assistance currently available with gantry cranes, but the quick and intuitive operator interface that currently is available only from unpowered rail systems is also desirable. Needed is better ergonomic performance than unpowered rail systems and greater dexterity and speed than gantry cranes allow. Also needed is the ability to use the IAD with larger payloads than current unpowered rail systems allow.

In addition, needed is the ability to connect and integrate a number of IAD components to work together, and a computer interface design that allows an technician or system integrator to easily program, operate and monitor the status of an IAD system made up of a plurality of components.

SUMMARY OF THE INVENTION

The present embodiments described herein address the need for natural and intuitive control of the motion of a payload by a human operator for ease of use and safety. According to the exemplary embodiments, disclosed is a modular architecture of components that can be programmed to create intelligent assist devices (“IADs) from a number of components. Disclosed is a modular system architecture coordinated by serial digital communication, to allow ease of configuration to a variety of applications. Also, the digital communication may be extended to allow integration with information networks within an industrial plant such as an integrated manufacturing or enterprise management system.

The embodiments further provide graphical configuration software which facilitates setup and maintenance of the IAD and allows the selection of user profiles customized such that each operator may be most comfortable with the behavior of the IAD. The software is allows integration, configuration and programming of components to perform tasks and simplify testing and monitoring of the system to increase ease of operation.

Provided are programmable modes of operation in which the operator may apply manual forces directly to the payload (“hands-on-payload” motion as described above), affording better control than possible when the operator’s hands must be placed only on the control locations.

According to an aspect of the embodiments, provided are Intent Sensors suited to intuitive and transparent control of motion in hands-on-controls mode, so-called because ideally they provide a measure of the intent of the operator for payload motion.

According to another aspect of the embodiments, provided is a means of clearly communicating the IAD mode of operation to the operator and the operator commands to change IAD operational modes. Further provided is an interface capability to system integrators, so that they may easily and economically integrate task-specific tooling to the functioning of the IAD.

According to another aspect of the embodiments, provided is a multi-functional Hub which serves as a communication center for the operator, integrator and for system components. The hub can also act as a mechanical component of the system to support a tooling or payload and integrate electrical and pneumatic components of the system.

The exemplary embodiments have many uses and advantages. In auto assembly for example, a computer prints out a paper “manifest” that travels with the vehicle, instructing the workers which parts to install on each vehicle. After assembly a quality inspection must be done to make sure that the right parts were in fact installed. If there are errors expensive rework is required. Using the exemplary embodiments, the IAD that a worker used to go fetch a part can be interfaced to a computer, which could, by monitoring the IAD’s trajectory, make sure the right part storage rack is being approached. By “tugging” a bit in the correct direction the IAD could help the worker select the correct rack. Accurate prediction of part count remaining in a rack could be made, and intra-plant deliveries of additional parts scheduled. Furthermore, there are other benefits to computer interface. Currently, assist devices are immobile when not driven by a worker. In contrast, a device that performs autonomous programmable motion is called a robot and if an operation is to be performed by a robot, human workers must be excluded from the vicinity for their own safety. So a particular task is generally either robotic or non-robotic, and with few options in between. IADs, however, by virtue of their computer interface can make mixed tasks possible, which may be termed “semi-autonomous behavior”. IADs make semi-autonomous behaviors possible in proximity and collaboration with human workers. Described herein are several examples of semi-autonomous behaviors motivated by automobile assembly that can be implemented by the exemplary embodiments.

For example, a line-tracking function can allow the operator to use both hands while the payload coasts along adjacent to the moving assembly line. Currently, the need to have the assist device follow along encourages both operators and plant engineers to leave the assist device physically enmeshed with the moving vehicle during such phases leading to unexpected collisions or entanglements that can lead to serious accidents.

A programmed “Drift away” feature can allow the payload to retreat from the moving assembly line to a safe location when it is unloaded (or when a button is pushed). Currently this can be accomplished with a hard shove or a tilted rail so that gravity pulls the payload away. Neither solution is satisfactory and both involve unnecessarily high payload speeds.

An Auto-return mode can allow the tooling to return to a loading station unattended while the operator continues work on the vehicle. The operator can therefore walk swiftly back to the loading station to pick up the next subassembly, unburdened by the empty tooling.

An auto-delivery mode in which the next subassembly is brought by the rail system, unattended, from the loading station to the current vehicle location. Using line tracking, the next vehicle’s location can be predicted accurately. However, should the vehicle location get out of phase for any reason, the operator simply moves the tooling manually to the correct location. Each subsequent delivery is referenced to the previous one, minus one vehicle length, plus line tracking. Thus, a synchronization problem is corrected quickly and almost unnoticed.

The above examples primarily benefit worker and industrial productivity. Semi-autonomous behaviors can also be implemented in support of safety.

As a first example, a resisting approach to the assembly line when the task phase is incorrect can be provided. A human operator can overpower the IAD, but its resistance serves as an hard-to-ignore signal that something is wrong. A second example is a Line emergency-stop when excessive force is detected, as for instance when the payload or tooling is caught in the moving assembly line.

Intelligent Assist Devices can also address ergonomics concerns. IADs can guide human & payload motion, minimizing the need for operator-produced lateral or stabilizing forces. Lateral and stabilizing forces use the muscles of the upper body and back, which are susceptible to injury.

Another ergonomic advantage relates to navigation & inertia management. IADs can assist in the maneuvering of large, unwieldy objects, especially where complicated motions or tight tolerances are necessary. Yet another ergonomic advantage relates to workspace isotropy, or avoiding the awkwardness of rail systems: heavy assemblies supported by overhead rails are often much easier to move parallel to the bridge rail than parallel to the fixed rails. This non-uniformity of workspace leads to awkward movements. IADs can mask the non-uniformity.

There are still yet other advantages as well. The foregoing and other features and advantages of the illustrative embodiments of the present invention will be more readily apparent from the following detailed description, which proceeds with references to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a high-level block diagram illustrating an exemplary modular architecture;

FIG. 2 is a diagram illustrating a perspective view of the exemplary trolley module of FIG. 1;

FIG. 3 is another diagram illustrating a perspective view of the trolley module of FIG. 1, with some parts removed for viewing;

FIG. 4 is yet another diagram illustrating a perspective view of the trolley module of FIG. 1, with some parts removed for viewing;

FIG. 5 is a diagram illustrating an exemplary passive trolley components of the trolley module of FIG. 1, and the manual release mechanism;

FIG. 6 is the gear train housing and roller shaft;

FIG. 7 is a diagram illustrating an exemplary motor and flywheel assembly;

FIG. 8 is a diagram illustrating a perspective view of the exemplary lift module of FIG. 1;

FIG. 9 is a diagram illustrating an exploded view of the exemplary reel assembly of the lift of FIG. 8;

FIG. 10 is a diagram illustrating in greater detail the reel and electrical components of FIG. 8;

FIG. 11 is a diagram illustrating the exemplary replaceable guide assembly of the lift of FIG. 1;

FIG. 12 is a diagram illustrating the exemplary motor and gear train of the lift of FIG. 1;

FIG. 13 is a diagram illustrating a perspective view of the front of the exemplary hub component of FIG. 1;

FIG. 14 is a diagram illustrating a perspective view of the rear of the hub of FIG. 1;

FIG. 15 is a diagram illustrating the rear of the exemplary hub with an access panel removed for viewing;

FIG. 16 is a diagram illustrating a perspective view of the internal components of the hub of FIG. 1;

FIG. 17 is a diagram illustrating a cross sectional view of the load cell and swivel assembly of the hub of FIG. 1;

FIG. 18 is a diagram illustrating a perspective view of the hub attached to the inline handle module;

FIG. 19 is a diagram illustrating a perspective view of many of the internal components of the inline handle of FIG. 18;

FIGS. 20a and 20b are diagrams illustrating a cutaway view of the internal components of the inline handle of FIG. 18;

FIG. 21 is a diagram illustrating a cut away view of many of the internal components of the inline handle of FIG. 18;

FIG. 22 is a diagram illustrating a perspective view of the pendant handle module;

FIG. 23 is a diagram illustrating a cutaway view of many of the internal components of the pendant handle module of FIG. 22;

FIG. 24 is a diagram illustrating a perspective view of a circuit board carrying switches and a hall sensor assembly positioned within the pendant handle of FIG. 22;

FIG. 25 is a diagram illustrating a cross section of the inside of the hall sensor assembly of FIG. 24;

FIG. 26 is a screen-shot illustrating the cover page of the graphical user interface (GUI) of the configuration software module;

FIG. 27 is a screen-shot illustrating the layout panel of the GUI of FIG. 26;

FIG. 28 is a screen-shot illustrating the identification panel of the GUI of FIG. 26;

FIG. 29 is a screen-shot illustrating the motion panel of the GUI of FIG. 26;

FIG. 30 is a screen-shot illustrating the vertical motion setup panel of the GUI of FIG. 26;

FIG. 31 is a screen-shot illustrating the lateral motion setup panel of the GUI of FIG. 26;

FIG. 32 is a screen-shot illustrating the hub logic setup panel of the GUI of FIG. 26;

FIG. 33 is a screen-shot illustrating the custom logic setup panel of the GUI of FIG. 26;

FIG. 34 is a screen-shot illustrating the profiles setup panel of the GUI of FIG. 26;

FIG. 35 is a block diagram illustrating exemplary inputs, outputs, and communication between the computational nodes of FIG. 1;

FIG. 36 is a block diagram illustrating the electronics of an exemplary computational node of FIG. 1;

FIG. 37 is a block diagram illustrating the electronics of an exemplary computational node on a Hub; and

FIG. 38 is a diagram illustrating an exemplary structure of a communication packet utilized in communication between the computational nodes of FIG. 1.