CSCI5570 Parameter Server Project Demonstration

In courtesy of the Husky team. Special thanks to Yuzhen Huang.

Install & Run

Git clone this repository by

git clone https://github.com/TatianaJin/csci5570.git
cd csci5570

Create a directory for putting compiled files, and configure cmake.

mkdir build && cd build
cmake .. -DCMAKE_BUILD_TYPE=Debug

See the make list by make help, and make anything in the list by make ${ANYTHING}

cd build/     # cd to the build directory
make -j4      # build all the targets
./HuskyUnitTest  # run all unit tests
./HuskyUnitTest --gtest_filter=TestServerThread.RegisterModel  # run a specific test

Tutorial 2

• The mailbox is provided as a bottom layer communication module
• The prototypes of server threads, worker threads, and communication threads are also provided for your reference
• There are some utility files for compilation and testing for your reference

Tutorial 3

• Check the overall picture about the worker and server in test/test_worker.cpp and test/test_server.cpp.
• Understand how the modules in the server side work together.
• Implement server_thread.cpp according to the information given in server_thread_test.cpp.
• Implement map_storage.hpp according to the information given in map_storage_test.cpp.

Tutorial 4

• Check base/abstract_partition_manager.hpp and implement your parititoning strategies
• You should have tried implementing MapStorage last week. You may try other storage method such as vector.
• Write a small program to link the paritition manager with the storages and to initialize storages associated with different server threads

Some tools:

• glog. You may use GLOG_logtostderr=1 ./HuskyUnitTest to print the LOG(INFO) information to the console.
• gtest.
• Actor model
• cmake
• C++ (C++11, multi-threading, std::move, rvalue reference, classes...)