Oracle Grid Engine

From Wikipedia, the free encyclopedia
  (Redirected from Sun Grid Engine)
Jump to: navigation, search
Oracle Grid Engine
GridEngine Logo
Developer(s) Oracle Corporation (formerly Sun Microsystems) in association with the community
Stable release 6.2u8 / October 1, 2012 (2012-10-01)
Operating system Cross-platform
Type Grid computing
License SISSL
Website oracle.com

Oracle Grid Engine,[1] previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director),[2] was a grid computing computer cluster software system (otherwise known as batch-queuing system), acquired as part of a purchase of Terraspring,[3] then improved and supported by Sun Microsystems and later Oracle. There have been open source versions and multiple commercial versions of this technology, initially from Sun, later from Oracle and then from Univa Corporation.

This technology forked from the same codebase as HP's UDC, and IBM's eLiza in 2002.[4]

On October 22, 2013 Univa announced it acquired the intellectual property and trademarks for the Grid Engine technology and that Univa will take over support.[5]

The original Grid Engine open-source project website closed in 2010, but versions of the technology are still available under its original Sun Industry Standards Source License.[6] Those projects were forked from the original project code and are known as Son of Grid Engine[7] and Open Grid Scheduler.[8]

Grid Engine is typically used on a computer farm or high-performance computing (HPC) cluster and is responsible for accepting, scheduling, dispatching, and managing the remote and distributed execution of large numbers of standalone, parallel or interactive user jobs. It also manages and schedules the allocation of distributed resources such as processors, memory, disk space, and software licenses.

Grid Engine used to be the foundation of the Sun Grid utility computing system, made available over the Internet in the United States in 2006,[9] later becoming available in many other countries and having been an early version of a public Cloud Computing facility predating Amazon AWS, for instance.

Features[edit]

The below feature sets date from the last Sun releases in 2009 or earlier. More current feature information can be found on the web sites of the open source forks or for Univa Grid Engine.

A screenshot of the xml-qstat web interface

Features in 6.2:

  • Advance reservation
  • Array job interdependencies
  • Rule-based Resource Quota control[10]
  • Enhanced remote execution (without using external rshd/rlogind/sshd processes)
  • Multi-clustering[11]
  • Daemons managed by the Service Management Facility on Solaris
  • Pseudo TTY (pty) support for interactive jobs
  • Job Submission Verifier (client-side and server-side job verification)
  • GUI Installer and SGE Inspect
  • Topology-aware scheduling and thread binding
  • Hadoop integration, Amazon EC2 integration for cloud computing

Other features of SGE include:

  • Multiple advanced scheduling algorithms allow powerful policy-based resource allocation
  • Cluster queues
  • Job and scheduler fault tolerance - Grid Engine continues to operate as long as there is one or more hosts available
  • Job checkpointing
  • Job arrays and job tasks
  • DRMAA (Job API)
  • Resource reservation
  • XML status reporting (qstat and qhost), and the xml-qstat[12] web interface
  • Parallel jobs (MPI, PVM, OpenMP), and scalable parallel job startup with qrsh[13]
  • Usage accounting
  • Accounting and Reporting COnsole (ARCO)
  • parallel make: distmake, dmake (Sun Studio), and SGE's own qmake
  • FLEXlm integration[14][15] and multi-cluster software license management with LicenseJuggler[16]

Platforms[edit]

Grid Engine runs on multiple platforms, including:

Cluster architecture[edit]

A typical Grid Engine cluster consists of a master host and one or more execution hosts. Multiple shadow masters can also be configured as hot spares, which take over the role of the master when the original master host crashes.[17]

Support and training[edit]

Univa is providing commercial support and training for Univa Grid Engine and Oracle Grid Engine. Below is a description of some of the historic options.

Sun provided support contracts for the commercial version of Grid Engine on most UNIX platforms and Windows.[18] Professional services, consulting, training, and support were provided by Sun Partners.[19] Sun partners with Georgetown University to deliver Grid Engine administration classes.[20] The Bioteam runs short SGE training workshops that are 1 or 2 days long.[21]

Users obtained community support on the Grid Engine mailing lists.[22] Grid Engine Workshops were held in 2002, 2003, 2007, 2009, and 2012 in Regensburg, Germany.[23]

Users[edit]

Again, the below contains historic information. More recent deplyoment information, specifically regarding commercial users, is available from Univa.

Notable deployments of SGE include:

History[edit]

In 2000, Sun acquired Gridware, Inc. a privately owned commercial vendor of advanced computing resource management software with offices in San Jose, Calif., and Regensburg, Germany.[28] Later that year, Sun offered a free version of Gridware for Solaris and Linux, and renamed the product Sun Grid Engine.

In 2001, Sun made the source code available,[29] and adopted the open source development model. Ports for Mac OS X and *BSD were contributed by the non-Sun open source developers.[30]

In 2010, after the purchase of Sun by Oracle, the Grid Engine 6.2 update 6 source code was not included with the binaries, and changes were not put back to the project's source repository. In response to this, the Grid Engine community started the Open Grid Scheduler project to continue to develop and maintain a free implementation of Grid Engine.[31][32][33]

On January 18, 2011, it was announced that Univa had recruited several principal engineers from the former Sun Grid Engine team and that Univa would be developing their own forked version of Grid Engine. The newly announced Univa Grid Engine did include commercial support and would compete with the official version of Oracle Grid Engine.[34][35][36]

On Oct 22, 2013 Univa has announced that it had acquired the intellectual property and trademarks pertaining to the Grid Engine technology and that Univa will take over support for Oracle Grid Engine customers.[37]

Other Grid Engine based products[edit]

Add-on software[edit]

A number of SGE add-ons are available:

See also[edit]

Portal icon Free software portal

References[edit]

  1. Jump up ^ "Oracle Grid Engine". Oracle Corporation. 2010-05-303.  Check date values in: |date= (help)
  2. Jump up ^ "A Little History Lesson". Sun Microsystems. 2006-06-23. 
  3. Jump up ^ http://www.bizjournals.com/sanfrancisco/stories/2002/11/11/daily85.html
  4. Jump up ^ http://www.crn.com/news/channel-programs/18838567/sun-acquires-terraspring-to-bolster-n1-strategy.htm
  5. Jump up ^ "Univa Completes Acquisition of Grid Engine Assets, Becoming the Sole Commercial Provider of Grid Engine Software". Univa Corporation. 2013-10-22. 
  6. Jump up ^ "The Grid Engine Source License". Sun MicroSystems. 2010-06-04. 
  7. Jump up ^ "Son of Grid Engine". University of Liverpool. 
  8. Jump up ^ "Open Grid Scheduler". The Open Grid Scheduler Community. 
  9. Jump up ^ "World's First Utility Grid Comes Alive on the Internet". Sun Microsystems. 2006-03-22. 
  10. Jump up ^ Specification: Resource Quota
  11. Jump up ^ "Hedeby Project home". Sun Microsystems. Archived from the original on January 5, 2009. Retrieved 2008-01-25. 
  12. Jump up ^ "xml-qstat". olesenm.github.com. Retrieved 2009-10-12. 
  13. Jump up ^ "Long delay when submitting large jobs (mailing list message)". Sun Microsystems. Retrieved 2007-12-25. 
  14. Jump up ^ "flex-grid". olesenm.github.com. Retrieved 2009-10-12. 
  15. Jump up ^ "Olesen-FLEXlm-Integration". wiki.gridengine.info. Retrieved 2007-12-25. 
  16. Jump up ^ "LicenseJuggler". wiki.gridengine.info. Retrieved 2007-12-26. 
  17. Jump up ^ "How to Install the Shadow Master Host". Sun Grid Engine 6.2u3 blog. August 27, 2009. Retrieved October 6, 2011. 
  18. Jump up ^ "Sun Store Grid Engine Entitlement Purchase". Sun Microsystems. Archived from the original on 2007-10-30. Retrieved 2008-03-03. 
  19. Jump up ^ "Sun Grid Engine 6 Partners". Sun Microsystems. Retrieved 2007-12-14. 
  20. Jump up ^ "Advanced Sun Grid Engine Configuration and Administration Class". Sun Microsystems. Retrieved 2007-12-14. 
  21. Jump up ^ "Training". The Bioteam Inc. Retrieved 2008-03-24. 
  22. Jump up ^ "Grid Engine Mail Lists". Sun Microsystems. Archived from the original on December 25, 2008. Retrieved October 6, 2011. 
  23. Jump up ^ "Grid Engine Workshops". Sun Microsystems. Archived from the original on March 8, 2009. Retrieved October 6, 2011. 
  24. Jump up ^ "Sun N1 Grid Engine Software and the Tokyo Institute of Technology Super Computer Grid". Sun Microsystems. Retrieved 2007-11-16. 
  25. Jump up ^ "TACC > HPC Systems". The University of Texas at Austin. Retrieved 2007-12-13. 
  26. Jump up ^ "More Ranger Facts and Figures". Sun Microsystems. Retrieved 2008-02-12. 
  27. Jump up ^ "TOP500 List - June 2008". TOP500.Org. 2006-06-18. 
  28. Jump up ^ "Gridware's resource management software increases efficiency and productivity in compute-intensive technical computing environments". Sun Microsystems. 2000-07-24. 
  29. Jump up ^ "Sun Microsystems makes SUN GRID ENGINE software available to open source community". Sun Microsystems. 2001-07-23. 
  30. Jump up ^ "Porting HPC Tools to FreeBSD". 2010-05-14. 
  31. Jump up ^ Open Grid Scheduler
  32. Jump up ^ Eadline, Ph.D., Douglas (September 1, 2010). "The State of Oracle/Sun Grid Engine". Linux Magazine. Retrieved 2011-01-18. 
  33. Jump up ^ Templeton, Daniel (2010-12-23). "Changes for a Bright Future at Oracle". Retrieved 2011-01-19. 
  34. Jump up ^ "Univa Acquires Grid Engine Expertise" (Press release). Univa. 2011-01-18. Retrieved 2011-01-18. 
  35. Jump up ^ Feldman, Michael (2011-01-18). "Univa Rescues Grid Engine From Oracle". HPCwire. Retrieved 2011-01-18. 
  36. Jump up ^ Morgan, Timothy Prickett (2011-01-18). "Univa forks Oracle's Sun Grid Engine". The Register. Retrieved 2011-01-18. 
  37. Jump up ^ "Univa Completes Acquisition of Grid Engine Assets, Becoming the Sole Commercial Provider of Grid Engine Software". Univa Corporation. 2013-10-22. 
  38. Jump up ^ "Sun Compute Cluster Solution". Sun Microsystems. 
  39. Jump up ^ "Installing and Configuring Sun Cluster HA for Sun Grid Engine". Sun Microsystems. 2008-02-15. 
  40. Jump up ^ "GT 5.0.0 Release Notes". 

External links[edit]

Wikimedia Commons has media related to Sun Grid Engine.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Oracle_Grid_Engine&oldid=712863497"