Commit Graph

44 Commits

Author SHA1 Message Date
zhu.boxiang
8bfc3ed08c fix: Only use system_session when use id filter
Only use system_session when use id filter

By default, id filter is valid for admin user.

Closes-Bug: #1957142
Change-Id: I57d3014f18e7b2ba832421453f45f71d04489e07
2022-03-24 18:55:31 +08:00
chenliufeiyang
461ddb6632 fix: Use admin permission to list volumes with ids
By default, id filter for list volumes is only availabe
for admin user. So if we login as a normal user. It will
fail to list volumes with ids.

So we use admin permission to list volumes with ids.

Closes-Bug: #1957142
Change-Id: Ia18bf377b34a11d11df898003242eb763f8cfeea
2022-03-17 13:38:20 +08:00
zhu.boxiang
6494ff6a46 fix: Fix the log_dir
If the log_dir is /var/log/kolla, and when we
deploy with devstack, we only chown the permission
for /var/log/kolla/skyline with stack user.
But the permission for /var/log/kolla is still root.
So it can not be access by stack user.
We will both change the log_dir in skyline-console
project.

Change-Id: I852c44cda2f9879aa8d8e405bb39bba13f35b8ca
2022-03-14 10:22:24 +08:00
yangshaoxue
c397f97cc4 fix: Add nginx option "listen_address" and "log_dir"
Add nginx option "listen_address" and "log_dir"

Change-Id: I161f76155b7cf34ef3bf4ea1f2416798aa533920
2022-02-16 13:42:13 +08:00
yangshaoxue
14433d9774 fix: update skyline nginx log file address
Update skyline nginx log file address

Change-Id: I150064a8a0175b073c2cb31303a812763cb02f78
2022-02-09 16:42:42 +08:00
zhu.boxiang
047f197844 refactor: Remove skyline-console submodule
1. Remove libs/skyline-console submodule
2. Delete .gitmodules file
3. Update the dependencies
4. Update the Dockerfile

Change-Id: I80eae423ba3c308bb7f4d817f9142d9877855e7a
2022-01-06 13:43:46 +08:00
zhu.boxiang
36e4e5ce0e chore: Update submodules
Update submodules of skyline-console

Change-Id: I8ca833da45979b0668e201d55c5dbc528edc9a24
2021-12-02 16:48:59 +08:00
Zuul
70babad06a Merge "feat: Add swift endpoint url when generate nginx.conf" 2021-11-29 03:49:01 +00:00
王晨
01582540ca feat: add query api
Add calling prometheus interface

Change-Id: I2aeac35d91c9b94dcd0549f1a0ac7ca25f6d268f
2021-11-26 07:08:38 +00:00
zhu.boxiang
c5ec9e0faf feat: Add swift endpoint url when generate nginx.conf
Add swift endpoint url when generate nginx.conf.
Add swift type into service mapping. Also update
the sample file of skyline.yaml.

Change-Id: Ib7dc4202bb390557afb665da7f5ae4004d40f324
2021-11-26 09:40:48 +08:00
zhu.boxiang
2fa6e6bd39 feat: Improve the enum value for port device owner
Improve the enum value for port device owner.
Refer: https://opendev.org/openstack/neutron-lib/src/branch/master/neutron_lib/constants.py#L43-L73

Change-Id: I61b3079ab88e78a53b8b2afa6c09463138cb3bbc
2021-11-05 16:41:57 +08:00
zhu.boxiang
f369b43f24 style: Change makefile for apiserver and nginx of skyline
1. fix makefile for apiserver and nginx of skyline
2. re-fmt and re-lint for project

Change-Id: I4800b19dad0e3031462f540ff4427ca750d6324f
2021-10-15 15:49:15 +08:00
zhu.boxiang
f1d38b6524 Fix: Add post-run into publish job
1. Add post-run into publish job
2. Update skyline-console submodule

Change-Id: Idd7263ed69f14fadf54f0850beb5bcbb930f672d
2021-10-11 13:30:27 +08:00
zhu.boxiang
7b61aeee13 Fix: Fail to publish package to tarballs
1. Use tox to make packages.
2. Change the way to install nodejs and yarn with nvm.
3. Update the skyline-console submodule

Change-Id: I363ec0dcda428701be2260893ebe97aa3dd77b5f
2021-10-08 16:15:44 +08:00
zhu.boxiang
54a496a57f refactor: Change the path of file alembic.ini
Change the path of file alembic.ini to skyline_apiserver/db/alembic.

Change-Id: Ic932dd4ed7350217a0db8eb766b863101d54f9af
2021-09-30 14:54:04 +08:00
Zuul
5614c154ea Merge "refactor: Remove -f of poetry build command" 2021-09-29 07:46:51 +00:00
Zuul
a51d72f018 Merge "test: Add skyline-config unit test" 2021-09-29 06:37:09 +00:00
zhu.boxiang
28429a0ac5 refactor: Remove -f of poetry build command
1. Remove -f of poetry build command. Merge two commands
as 'poetry build'.
2. Update submodule for skyline-console

Change-Id: I91a04439c3a605a0159890a4603684a785d7a90c
2021-09-29 14:10:13 +08:00
Zuul
9a8dabe7bb Merge "test: Add skyline-log unit test" 2021-09-29 05:14:34 +00:00
Gao Hanxiang
c81b6e11d2 test: Add skyline-config unit test
1. Add skyline-config unit test case and tools
2. Update immutables package type annotation
3. Adjust get_config_path function

Change-Id: Idc70ac164247c0d9cd5135f4e5bbef3994d05f22
2021-09-29 04:30:26 +00:00
Gao Hanxiang
1d14b4067c test: Add skyline-policy-manager unit test
1. Add skyline-policy-manager unit test case and tools
2. Update `setup` method type annotation
3. Move some constants to `skyline_policy_manager.constants`
4. Adjust import to use modules instead of functions
5. Update code format

Change-Id: Ic72e21126de0b16e4d969ad48ce64c57542c4667
2021-09-29 02:50:31 +00:00
Gao Hanxiang
841a224590 test: Add skyline-log unit test
1. Add skyline-log unit test case and tools
2. Update `setup` method type annotation

Change-Id: Icc0ce98063e32501b75525f36262a1ed4c99e61f
2021-09-29 02:50:02 +00:00
zhu.boxiang
da42ade264 feat: Add build sdist
1. add build sdist into Makefile
2. update the submodule for skyline-console

It's ready for kolla to build image with source packages.

Change-Id: Iee016f241e5c141de4f135a35a406517b3f87e1f
2021-09-27 18:03:35 +08:00
zhu.boxiang
12c0618314 feat: Add ironic and octavia into service_mapping
1. add ironic into service_mapping
2. add octavia into service_mapping
3. change interface_type as public

Change-Id: I9ffa419ffac3b7f20784cf7ae4e12a26e3e6bb4d
2021-09-24 16:39:49 +08:00
Gao Hanxiang
1eebe91eaf chore: Update dependencies
1. Update python dependencies
2. Update skyline-console

Change-Id: I9417671b8fecef76a4e00f1bf98877552801f66e
2021-09-23 12:33:16 -04:00
zhu.boxiang
de4adde69e feat: Support devstack integrated functional test
1. add skyline-functional-devstack which inherits from devstack
2. add skyline-functional-devstack into check and gate job
3. add playbook to integrate with devstack for zuul
4. change the port from 8080 to 9999 because the 8080 is used for s3api
5. rename functional-py38 as unittest-py38
6. add install extra tools ready for skyline-console's e2e test

Change-Id: I7f4b549bec6573661e62dd2bd9a3355253afd47d
2021-09-16 13:31:55 +08:00
zhu.boxiang
809802d920 fix: Change the version of setuptools
The setuptools(>=58.0.0) has removed the support of use_2to3 during build[1].
There is a package named tempita[2] which has set use_2to3 in setup.py.

So here, we set the version of setuptools less than 58.0.0

[1]: https://setuptools.readthedocs.io/en/latest/history.html#v58-0-0
[2]: https://github.com/agramfort/tempita/blob/master/setup.py#L53

Change-Id: I0fffaa63eb91c4d4c4bf8d7e149e7087e514aa51
2021-09-10 17:56:44 +08:00
Wu Wenxiang
b8be76df8a fix: get domain always from admin interface
Use config interface in keystone client, rather than default value.

Closes-bug: #1940148
Change-Id: Id0cec1e488f854bfd6e2321e6abe9ac6d5f4a486
2021-09-08 16:37:00 +08:00
zhu.boxiang
f5c946e1c6 fix: Double all_projects params
Input double all_projects params when calling list_projects
function. Remove one of them.

Closes-Bug: #1942087
Change-Id: I7cc80dcb497a2996d50770e6c2b29c9779640e85
2021-08-31 16:58:05 +08:00
zhu.boxiang
4abe8d4032 fix: Lack of import constants
Use constants in contrib but lack of import it.
Here we import constants from skyline_apiserver.types to fix it.

Closes-Bug: #1942087
Change-Id: I6fd874400f77e9d201d6c5d7284c78345d52b63f
2021-08-31 11:52:00 +08:00
chenliufeiyang
6dfa997a79 feature: Add x-openstack-request-id into header
1. Add x-openstack-request-id into header
Let the skyline API continue to pass down with Request ID using for tracking chain.
It contributes to find the problem preliminarily.

Change-Id: Ib7f7dcc98183aa99a00fc69b73eba53d87642502
2021-08-25 12:47:26 +08:00
Zuul
bea439480a Merge "fix: Re-generate the poetry.lock" 2021-08-23 14:48:33 +00:00
zhu.boxiang
f3ee9d3b8c fix: Re-generate the poetry.lock
The skyline-nginx is dependent on skyline-apiserver.
From the patch[0], we add aiosqlite into tool.poetry.dependencies.
So we need to re-generate the poetry.lock of skyline-nginx.

[0]: https://review.opendev.org/c/skyline/skyline-apiserver/+/803539

Change-Id: I82dc76ed286376d2c388e1dab95d4c24743d02f2
2021-08-23 13:32:45 +08:00
chenliufeiyang
ebf89092fd fix: Fix params' default value of function
1. Do not use mutable types as method parameter defaults

Change-Id: Ie310114f53981451b50a366a0869be72bbfb4e01
2021-08-20 15:11:12 +08:00
zhu.boxiang
c78ef2f522 fix: Update README doc and fix dependency
Update the develop chapter of README doc.
Also fix the aiosqlite dependency if skyline-apiserver.

Change-Id: Ie769037872dcc64f2f83013869f98028846b242f
2021-08-05 14:31:13 +08:00
Gao Hanxiang
3176cfbc47 fix: 400 page appears when using http protocol to access
When using http protocol to access, nginx will respond with 400 and
report "400 The plain HTTP request was sent to HTTPS port".
The reason is that http 497 error[1] appeared in nginx, so 497
error was redirected to https protocol.

[1] 56f5331683/src/http/ngx_http_special_response.c (L274)

Change-Id: I01c35318dd5d219dbb31e6a89bdc05d2a4db7804
2021-07-29 05:28:58 +00:00
Gao Hanxiang
acf17c752b fix: Add timeout to keystone session
When a network failure occurs, the openstack client will be blocked for
a long time. Set a timeout on the session to feedback network problem
as soon as possible.

Change-Id: I2eec95b18241b0bf2103ad3dfa1efd2774f2bd77
2021-07-29 01:20:35 -04:00
Gao Hanxiang
8d8c8bd89f chore: Add make clean to clean up project directory
1. Add make clean
2. Specify configuration file used by mypy
3. Add some directories to dockerignore

Change-Id: I4f6b0d5ba894214bb0fcff21443f9808f56d595e
2021-07-26 14:35:55 +00:00
Gao Hanxiang
4fa4083d57 refactor: Streamline libs directory structure
1. Adjust makefile
2. Delete unused files

Change-Id: I73a7490e658763b57ef528359ebbde6d945740db
2021-07-26 03:50:00 +00:00
Gao Hanxiang
4935be6f47 refactor: Move skyline-apiserver to libs
1. Move skyline-apiserver to libs
2. Modify Makefile
3. Rename the skyline-apiserver.yaml.sample file to skyline.yaml.sample

At the top level, we use "skyline" as the namespace, using the idea of
monorepo to manage the project. At the top level, only some common
configuration files (mypy.ini, black.conf, isort.conf, etc.) and
common tools are included.

In the `libs` directory, there are three core libraries,
skyline-console, skyline-apiserver, skyline-nginx, and some dependent
libraries.
There are cross-imports between these libraries,
for example: skyline-nginx requires skyline-apiserver;
Both skyline-nginx and skyline-apiserver require skyline-config.

Therefore, skyline-apiserver should not be placed
at the top level, it is also suitable for management as a library.


Change-Id: Ie2f1f4bdfbc2e985ec4327705eecaae3181f5b50
2021-07-26 03:48:54 +00:00
Gao Hanxiang
5e4f40f364 feat: Add skyline-nginx package
1. Add skyline-nginx package for managing and generating nginx
   configuration.

Change-Id: I68afd9ab9ad52fc96c13e745cb1e89a8061a53ba
2021-07-26 03:46:20 +00:00
Gao Hanxiang
dfaf962aca feat: Add skyline-console to submodule
When building a docker image, skyline-console is required,
so add skyline-console as a git submodule.

Change-Id: I429879dbfb93f48aacbe09966388f25a5afab43d
2021-07-19 02:46:39 +00:00
zhu.boxiang
826234e9db feat: Add skyline-config under libs
1. remove base.py under config folder
2. add skyline-config library under libs

Change-Id: I71561bc3f6acbff3d90c9ad1922095e71497f226
2021-07-07 16:14:11 +08:00
Hanxiang Gao
38ea9e3d59 feat: Add initial code of skyline-apiserver
Add initial code of skyline-apiserver

Change-Id: Ib425960b707237193fd8531fb3989f29282f5b58
2021-06-01 23:39:57 +08:00