Conversation
* adding api changes * fixing site packages * fixing pycylon * Arrow 16 Updates - fixes actions * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial (bug fixes) * FMI integration - partial (bug fixes) * FMI integration - partial (bug fixes) - pre-establishes connection to handle greedy nb sends and receives from cylon * FMI integration - partial (remove local receives (FMI does not support this) + other improvements * FMI integration - partial * FMI integration - partial * FMI integration - partial (2 node example success!) * FMI integration - partial * FMI integration - partial (cython updates) * FMI integration - partial (cython updates) * FMI integration - partial (bug fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) - adds blocking support based on problems with AWS Lambda integration * FMI integration - partial (cython fixes) - adds blocking support based on problems with AWS Lambda integration * FMI integration - partial (cython fixes) - adds blocking support based on problems with AWS Lambda integration * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - nonblocking support using raw sockets * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * Ping message - initial support for non-blocking to prevent socket closure * updates lambda dockerfile to use nonblocking-ping branch (ping for non-blocking sockets to prevent nat firewall closure * Ping message - initial support for non-blocking to prevent socket closure * Ping message - initial support for non-blocking to prevent socket closure * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Ping message - initial support for non-blocking to prevent socket closure * Updates dockerfile to use nonblocking cylon fmi branch * Ping message - adds configurable ping for non-blocking sockets for cases where this capability is not necessary * Updates dockerfile to use nonblocking cylon fmi branch (script updates) * Adds dynamic rank calculation for running in ecs where the rank is not known in advance (FMI) * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * bug fix for dynamic rank generation * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * Reorganizes parser arguments alphabetically by env variable name * Reorganizes parser arguments alphabetically by env variable name * bug fixes for fargate docker * adds retries for nonblocking socket connection establishment * adds retries for nonblocking socket connection establishment * bug fixes for fargate docker * updating error message in tcpunch library to help debug timeout root cause * fixes build issue related to arm arch running within parallels on macosx * removes unnecessary comments * updates env variable style * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * adds the rust/doc, gcylon updated architecture, libfabric design and the checkpointing design * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * updates env variable style * updates env variable style * updates env variable style * updates env variable style * gcylon updates * gcylon updates * updates env variable style * updates env variable style * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * wasm SIMD changes * wasm cylon integration * wasm cylon integration * wasm cylon integration * cylon c++/rust fmi s3/redis integration * cylon c++/rust fmi s3/redis integration * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * pre-cylon mirror merge * pre-cylon mirror merge * pre-cylon mirror merge * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * adds cylon AWS step function code --------- Co-authored-by: niranda perera <niranda.perera@gmail.com>
* FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial * FMI integration - partial (bug fixes) * FMI integration - partial (bug fixes) * FMI integration - partial (bug fixes) - pre-establishes connection to handle greedy nb sends and receives from cylon * FMI integration - partial (remove local receives (FMI does not support this) + other improvements * FMI integration - partial * FMI integration - partial * FMI integration - partial (2 node example success!) * FMI integration - partial * FMI integration - partial (cython updates) * FMI integration - partial (cython updates) * FMI integration - partial (bug fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) - adds blocking support based on problems with AWS Lambda integration * FMI integration - partial (cython fixes) - adds blocking support based on problems with AWS Lambda integration * FMI integration - partial (cython fixes) - adds blocking support based on problems with AWS Lambda integration * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * FMI integration - nonblocking support using raw sockets * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * Ping message - initial support for non-blocking to prevent socket closure * Ping message - initial support for non-blocking to prevent socket closure * Ping message - initial support for non-blocking to prevent socket closure * Ping message - adds configurable ping for non-blocking sockets for cases where this capability is not necessary * Updates dockerfile to use nonblocking cylon fmi branch (script updates) * Reorganizes parser arguments alphabetically by env variable name * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration # Conflicts: # rust/DISTRIBUTED_OPERATIONS_ROADMAP.md * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * gcylon updates * updates env variable style * gcylon updates * updates env variable style * updates env variable style * gcylon updates * gcylon updates * gcylon updates * wasm cylon integration * wasm cylon integration * wasm cylon integration * cylon c++/rust/js partial * cylon c++/rust/js partial * workflow fixes * workflow fixes * workflow fixes * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * gcylon tests, architecture, and optimizations * gcylon tests, architecture, and optimizations * gcylon tests, architecture, and optimizations * step function payload definition update * gcylon updates * adds support for s3 and redis fmi communicators in scaling.py * updates experiment plan for frontiers to be capped at 32 nodes (function invocations) * updates experiment plan for frontiers to be capped at 32 nodes (function invocations) * redis/s3 fixes for fmi communicator * misc frontiers updates * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * updates related to frontiers experiments * updates related to frontiers experiments * updates related to frontiers experiments * propagates c++ s3/redis changes to rust + adjust barrier implementation for s3/redis to account for race conditions during processing * removes 32 node groupby experiment * misc frontiers updates * removes 32 node groupby experiment * removes 32 node groupby experiment * updates groupby experiment to use combiner * updates groupby experiment to use combiner * fixes groupby scaling experiments and increases fonts for generated charts
* FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * adds updated docker for cylon fmi experiments * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - nonblocking support using raw sockets * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * FMI integration - partial (cython fixes) * Ping message - initial support for non-blocking to prevent socket closure * updates lambda dockerfile to use nonblocking-ping branch (ping for non-blocking sockets to prevent nat firewall closure * Ping message - initial support for non-blocking to prevent socket closure * Ping message - initial support for non-blocking to prevent socket closure * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Updates dockerfile to use nonblocking cylon fmi branch * Ping message - initial support for non-blocking to prevent socket closure * Updates dockerfile to use nonblocking cylon fmi branch * Ping message - adds configurable ping for non-blocking sockets for cases where this capability is not necessary * Updates dockerfile to use nonblocking cylon fmi branch (script updates) * Adds dynamic rank calculation for running in ecs where the rank is not known in advance (FMI) * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * bug fix for dynamic rank generation * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * Reorganizes parser arguments alphabetically by env variable name * Reorganizes parser arguments alphabetically by env variable name * bug fixes for fargate docker * adds retries for nonblocking socket connection establishment * adds retries for nonblocking socket connection establishment * bug fixes for fargate docker * updating error message in tcpunch library to help debug timeout root cause * fixes build issue related to arm arch running within parallels on macosx * removes unnecessary comments * updates env variable style * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * adds the rust/doc, gcylon updated architecture, libfabric design and the checkpointing design * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * updates env variable style * updates env variable style * updates env variable style * updates env variable style * gcylon updates * gcylon updates * updates env variable style * updates env variable style * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * wasm SIMD changes * wasm cylon integration * wasm cylon integration * wasm cylon integration * cylon c++/rust fmi s3/redis integration * cylon c++/rust fmi s3/redis integration * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * pre-cylon mirror merge * pre-cylon mirror merge * pre-cylon mirror merge * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * adds cylon AWS step function code * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * gcylon tests, architecture, and optimizations * gcylon tests, architecture, and optimizations * gcylon tests, architecture, and optimizations * step function payload definition update * gcylon updates * adds support for s3 and redis fmi communicators in scaling.py * updates experiment plan for frontiers to be capped at 32 nodes (function invocations) * updates experiment plan for frontiers to be capped at 32 nodes (function invocations) * misc frontiers updates * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * updates related to frontiers experiments * updates related to frontiers experiments * updates related to frontiers experiments * propagates c++ s3/redis changes to rust + adjust barrier implementation for s3/redis to account for race conditions during processing * misc frontiers updates * removes 32 node groupby experiment * removes 32 node groupby experiment * removes 32 node groupby experiment * updates groupby experiment to use combiner * updates groupby experiment to use combiner * fixes groupby scaling experiments and increases fonts for generated charts * misc frontiers updates * misc frontiers updates * removes docs from wip * Revert "removes docs from wip" This reverts commit aa3fa86. * removes docs from wip * fixes groupby scaling experiments and increases fonts for generated charts * dockerfile updates (gcylon) * libfabric c++, rust changes + tcpunch protocol v2 support for v2 in c++ * adds checkpointing support to c++ with unit tests * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue
* Updates dockerfile to use nonblocking cylon fmi branch (script updates) * Adds dynamic rank calculation for running in ecs where the rank is not known in advance (FMI) * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * bug fix for dynamic rank generation * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * changes rank to default to -1 (ideally fmi should use redis to dynamically determine rank) * Reorganizes parser arguments alphabetically by env variable name * Reorganizes parser arguments alphabetically by env variable name * bug fixes for fargate docker * adds retries for nonblocking socket connection establishment * adds retries for nonblocking socket connection establishment * bug fixes for fargate docker * updating error message in tcpunch library to help debug timeout root cause * fixes build issue related to arm arch running within parallels on macosx * removes unnecessary comments * updates env variable style * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * adds the following to assist connection establishment: 1) Add bounded retry logic to the peer connection loop, 2) Adds exponential backoff during pairing, 3) Adds a timeout to the listening thread * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * cylon rust integration * adds the rust/doc, gcylon updated architecture, libfabric design and the checkpointing design * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * updates env variable style * updates env variable style * updates env variable style * updates env variable style * gcylon updates * gcylon updates * updates env variable style * updates env variable style * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * gcylon updates * wasm SIMD changes * wasm cylon integration * wasm cylon integration * wasm cylon integration * cylon c++/rust fmi s3/redis integration * cylon c++/rust fmi s3/redis integration * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * cylon c++/rust/js partial * pre-cylon mirror merge * pre-cylon mirror merge * pre-cylon mirror merge * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * workflow fixes * adds cylon AWS step function code * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * changes related to the frontier hpc cloud review of Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications * gcylon tests, architecture, and optimizations * gcylon tests, architecture, and optimizations * gcylon tests, architecture, and optimizations * step function payload definition update * gcylon updates * adds support for s3 and redis fmi communicators in scaling.py * updates experiment plan for frontiers to be capped at 32 nodes (function invocations) * updates experiment plan for frontiers to be capped at 32 nodes (function invocations) * misc frontiers updates * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * redis/s3 fixes for fmi communicator * updates related to frontiers experiments * updates related to frontiers experiments * updates related to frontiers experiments * propagates c++ s3/redis changes to rust + adjust barrier implementation for s3/redis to account for race conditions during processing * misc frontiers updates * removes 32 node groupby experiment * removes 32 node groupby experiment * removes 32 node groupby experiment * updates groupby experiment to use combiner * updates groupby experiment to use combiner * fixes groupby scaling experiments and increases fonts for generated charts * misc frontiers updates * misc frontiers updates * removes docs from wip * Revert "removes docs from wip" This reverts commit aa3fa86. * removes docs from wip * fixes groupby scaling experiments and increases fonts for generated charts * dockerfile updates (gcylon) * libfabric c++, rust changes + tcpunch protocol v2 support for v2 in c++ * adds checkpointing support to c++ with unit tests * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * fixes checkpoint pcylon compilation issue * exposes simd in c++ cylon * rust/wasm context table support * broadcast and all_gather for distributed operations in context_table * broadcast and all_gather for distributed operations in context_table * broadcast and all_gather for distributed operations in context_table * removes context table from cylon * removes context table from cylon * fmi merge fixes * remove logging colors for cloudwatch formatting * fixes tcpunch unecessary padding which breaks python/c++ * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * fix rust fmi rendezvous handshake * merge with mirror * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue) * merge with mirror (fix pip issue)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.