RT Journal Article
T1 GWpilot: Enabling multi-level scheduling in distributed infrastructures with GridWay and pilot jobs
A1 Huedo Cuesta, Eduardo
A1 Rubio-Montero, A. J.
A1 Castejón, F.
A1 Mayo-García, R.
AB Current systems based on pilot jobs are not exploiting all the scheduling advantages that the technique offers, or they lack compatibility or adaptability. To overcome the limitations or drawbacks in existing approaches, this study presents a different general-purpose pilot system, GWpilot. This system provides individual users or institutions with a more easy-to-use, easy-toinstall, scalable, extendable, flexible and adjustable framework to efficiently run legacy applications. The framework is based on the GridWay meta-scheduler and incorporates the powerful features of this system, such as standard interfaces, fair-share policies, ranking, migration, accounting and compatibility with diverse infrastructures. GWpilot goes beyond establishing simple network overlays to overcome the waiting times in remote queues or to improve the reliability in task production. It properly tackles the characterisation problem in current infrastructures, allowing users to arbitrarily incorporate customised monitoring of resources and their running applications into the system. This functionality allows the new framework to implement innovative scheduling algorithms that accomplish the computational needs of a wide range of calculations faster and more efficiently. The system can also be easily stacked under other software layers, such as self-schedulers. The advanced techniques included by default in the framework result in significant performance improvements even when very short tasks are scheduled.
PB North-Holland Publishing
SN 0167-739X
YR 2015
FD 2015-04
LK https://hdl.handle.net/20.500.14352/23357
UL https://hdl.handle.net/20.500.14352/23357
LA eng
NO DOI: 10.1016/j.future.2014.10.003
NO Unión Europea. FP7
NO Ministerio de Economía y Competitividad (MINECO)
DS Docta Complutense
RD 24 ago 2025