Sep 10 13:08:56 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 13:08:56 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 13:08:56 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 13:08:57 devstack cinder-volume[75436]: INFO dbcounter [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Registered counter for database cinder Sep 10 13:08:57 devstack cinder-volume[75436]: DEBUG oslo_db.sqlalchemy.engines [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:08:58 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writer thread running {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 13:08:58 devstack cinder-volume[75436]: INFO cinder.rpc [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 13:08:58 devstack cinder-volume[75436]: INFO cinder.rpc [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 13:08:58 devstack cinder-volume[75436]: DEBUG oslo_db.sqlalchemy.engines [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:08:58 devstack cinder-volume[75436]: INFO cinder.volume.manager [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Determined volume DB was empty at startup. Sep 10 13:08:58 devstack cinder-volume[75436]: DEBUG cinder.volume.manager [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75436) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 13:08:58 devstack cinder-volume[75436]: INFO cinder.volume.manager [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 13:08:58 devstack cinder-volume[75436]: WARNING stevedore.named [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 13:08:58 devstack cinder-volume[75436]: WARNING castellan.key_manager [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 13:08:58 devstack cinder-volume[75436]: WARNING cinder.keymgr.conf_key_mgr [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 13:08:58 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75436) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 10 13:08:58 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] CMD "cinder-rtstool verify" returned: 0 in 0.854s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_db.sqlalchemy.engines [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:08:59 devstack cinder-volume[75436]: INFO cinder.rpc [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 13:08:59 devstack cinder-volume[75436]: INFO cinder.rpc [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 13:08:59 devstack cinder-volume[75436]: WARNING stevedore.named [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 13:08:59 devstack cinder-volume[75436]: WARNING castellan.key_manager [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 13:08:59 devstack cinder-volume[75436]: INFO cinder.volume.manager [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_db.sqlalchemy.engines [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:08:59 devstack cinder-volume[75436]: INFO oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Starting 1 workers Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Started child 75608 {{(pid=75436) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Full set of CONF: {{(pid=75436) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] ******************************************************************************** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Configuration options gathered from: {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] ================================================================================ {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] allow_availability_zone_fallback = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] allow_compression_on_image_upload = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] allowed_direct_url_schemes = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] api_rate_limit = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] auth_strategy = keystone {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] az_cache_duration = 3600 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_availability_zone = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75608]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_host = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_stats_polling_interval = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backup_api_class = cinder.backup.api.API {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backup_name_template = backup-%s {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backup_use_same_host = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backup_use_temp_snapshot = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] chap_password = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] chap_username = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_internal_tenant_project_id = 8493c00625a04fb086f181a0a12fe007 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_internal_tenant_user_id = da11d2e090db47858702ec60b144e4c1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:08:59 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cloned_volume_same_az = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cluster = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] compression_format = gzip {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] compute_api_class = cinder.compute.nova.API {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] config_dir = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] config_source = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] control_exchange = openstack {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] debug = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] default_availability_zone = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] default_group_type = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] default_volume_type = lvmdriver-1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] driver_client_cert = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] driver_client_cert_key = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] driver_data_namespace = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] driver_ssl_cert_path = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] driver_ssl_cert_verify = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] driver_use_ssl = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] enable_force_upload = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] enable_new_services = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] enable_unsupported_driver = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] enforce_multipath_for_image_xfer = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] filter_function = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_api_insecure = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_api_servers = ['http://192.168.122.43/image'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_api_ssl_compression = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_ca_certificates_file = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_catalog_info = image:glance:publicURL {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_num_retries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance_request_timeout = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] goodness_function = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] graceful_shutdown_timeout = 5 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] group_api_class = cinder.group.api.API {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] host = devstack {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_compress_on_upload = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_conversion_address_space_limit = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_conversion_cpu_limit = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_conversion_disable = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_upload_use_cinder_backend = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_upload_use_internal_tenant = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_volume_cache_enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_volume_cache_max_count = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] image_volume_cache_max_size_gb = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] init_host_max_objects_retrieval = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] instance_format = [instance: %(uuid)s] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] iscsi_iotype = fileio {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] iscsi_target_flags = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] iscsi_write_cache = on {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] iser_helper = tgtadm {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] iser_ip_address = 192.168.122.43 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] iser_port = 3260 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_color = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_config_append = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_dir = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_file = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_options = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_rotate_interval = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_rotate_interval_type = days {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] log_rotation_type = none {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] max_age = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] max_logfile_count = 30 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] max_logfile_size_mb = 200 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] max_over_subscription_ratio = 20.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] message_reap_interval = 86400 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] message_ttl = 2592000 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] migration_create_volume_timeout_secs = 300 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] monkey_patch = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] monkey_patch_modules = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] my_ip = 192.168.122.43 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] no_snapshot_gb_quota = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] num_iser_scan_tries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] num_shell_tries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] num_volume_device_scan_tries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] nvmeof_conn_info_version = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] nvmet_ns_id = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] nvmet_port_id = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] osapi_max_limit = 1000 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] osapi_volume_ext_list = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] osapi_volume_listen_port = 8776 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] osapi_volume_use_ssl = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] osapi_volume_workers = 2 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] per_volume_size_limit = -1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] periodic_fuzzy_delay = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] periodic_interval = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] public_endpoint = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] publish_errors = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] quota_backup_gigabytes = 1000 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] quota_backups = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] quota_gigabytes = 1000 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] quota_groups = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] quota_snapshots = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] quota_volumes = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] rate_limit_burst = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] rate_limit_except_level = CRITICAL {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] rate_limit_interval = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] reinit_driver_count = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] replication_device = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] report_discard_supported = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] report_interval = 120 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] reservation_clean_interval = 86400 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] reservation_expire = 86400 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] reserved_image_namespaces = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] reserved_percentage = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] rpc_response_timeout = 120 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] run_external_periodic_tasks = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] scst_target_driver = iscsi {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] scst_target_iqn_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_down_time = 720 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] shell_completion = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] snapshot_name_template = snapshot-%s {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] snapshot_same_host = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] split_loggers = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] state_path = /opt/stack/data/cinder {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] storage_availability_zone = nova {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] storage_protocol = iSCSI {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] syslog_log_facility = LOG_USER {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] target_helper = lioadm {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] target_ip_address = 192.168.122.43 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] target_port = 3260 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] target_protocol = iscsi {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] target_secondary_ip_addresses = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] trace_flags = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] transport_url = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] until_refresh = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] use_chap_auth = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] use_default_quota_class = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] use_journal = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] use_json = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] use_multipath_for_image_xfer = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] use_stderr = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] use_syslog = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] verify_glance_signatures = enabled {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_api_class = cinder.volume.api.API {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_backend_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_clear = zero {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_clear_ionice = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_clear_size = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_copy_bps_limit = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_dd_blocksize = 1M {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_name_template = volume-%s {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_service_inithost_offload = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volume_usage_audit_period = month {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] watch_log_file = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] zoning_mode = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_concurrency.disable_process_locking = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.admin_password = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.admin_token = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.admin_user = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_port = 35357 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_protocol = https {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_section = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_type = password {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_uri = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.auth_version = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.cache = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.identity_uri = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.include_service_catalog = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.insecure = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.interface = public {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_password = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcache_username = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.region_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.service_type = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.backend = dogpile.cache.null {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.backend_argument = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.backend_expiration_time = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.config_prefix = cache.oslo {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.dead_timeout = 60.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.debug_cache_backend = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.enable_retry_client = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.enable_socket_keepalive = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.enforce_fips_mode = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.expiration_time = 600 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.hashclient_retry_attempts = 2 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_dead_retry = 300 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_password = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_pool_maxsize = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_sasl_enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.memcache_username = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.proxies = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.redis_db = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.redis_password = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.redis_server = localhost:6379 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.redis_socket_timeout = 1.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.redis_username = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.retry_attempts = 2 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.retry_delay = 0.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.socket_keepalive_count = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.socket_keepalive_idle = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.socket_keepalive_interval = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.tls_allowed_ciphers = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.tls_cafile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.tls_certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.tls_enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cache.tls_keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] coordination.backend_url = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.asyncio_connection = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.asyncio_slave_connection = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.backend = sqlalchemy {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.connection = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.connection_debug = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.connection_parameters = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.connection_recycle_time = 3600 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.connection_trace = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.db_inc_retry_interval = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.db_max_retries = 20 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.db_max_retry_interval = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.db_retry_interval = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.max_overflow = 50 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.max_pool_size = 5 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.max_retries = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.mysql_wsrep_sync_wait = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.pool_timeout = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.retry_interval = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.slave_connection = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.sqlite_synchronous = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] database.use_db_reconnect = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.connection_string = messaging:// {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.es_doc_type = notification {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.es_scroll_size = 10000 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.es_scroll_time = 2m {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.filter_error_trace = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.hmac_keys = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.sentinel_service_name = mymaster {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.socket_timeout = 0.1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.trace_requests = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler.trace_sqlalchemy = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler_jaeger.process_tags = {} {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler_jaeger.service_name_prefix = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] profiler_otlp.service_name_prefix = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.enforce_new_defaults = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: WARNING oslo_config.cfg [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.enforce_scope = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.policy_default_rule = default {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.policy_file = policy.yaml {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] privsep_osbrick.group = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] privsep_osbrick.helper_command = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] privsep_osbrick.user = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_sys_admin.group = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_sys_admin.helper_command = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] cinder_sys_admin.user = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.auth_section = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.auth_type = password {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.collect_timing = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.insecure = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.send_service_user_token = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.split_loggers = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] service_user.timeout = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.auth_section = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.auth_type = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.cafile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.collect_timing = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.insecure = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.split_loggers = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] glance.timeout = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.backend_availability_zone = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.chap_password = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.chap_username = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.142s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.driver_client_cert = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.driver_client_cert_key = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.driver_data_namespace = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.driver_use_ssl = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.extra_capabilities = {} {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.filter_function = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.goodness_function = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.iscsi_iotype = fileio {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.iscsi_target_flags = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.iscsi_write_cache = on {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.iser_helper = tgtadm {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.iser_ip_address = 192.168.122.43 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.iser_port = 3260 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.lvm_share_target = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.lvm_type = auto {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.num_shell_tries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.replication_device = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.report_discard_supported = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.reserved_percentage = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.target_helper = tgtadm {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.target_ip_address = 192.168.122.43 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.target_port = 3260 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.target_protocol = iscsi {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.trace_flags = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.unique_fqdn_network = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.use_chap_auth = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_backend_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_clear = zero {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_clear_ionice = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_clear_size = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_reports.file_event_handler = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_reports.log_dir = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.backend_host = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.chap_password = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.chap_username = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.driver_client_cert = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.extra_capabilities = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.filter_function = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.goodness_function = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.iscsi_iotype = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.iser_helper = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.iser_ip_address = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.iser_port = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.lvm_share_target = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.lvm_type = auto {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.num_shell_tries = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.replication_device = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.report_discard_supported = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.reserved_percentage = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.scst_target_driver = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.storage_protocol = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.target_helper = lioadm {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.target_ip_address = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.target_port = 3260 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.trace_flags = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.use_chap_auth = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_clear = zero {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_clear_size = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] lvmdriver-1.volumes_dir = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.ssl = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_notifications.driver = [] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_notifications.retry = -1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] key_manager.fixed_key = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.barbican_api_version = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.barbican_endpoint = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.barbican_endpoint_type = public {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.barbican_region_name = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.cafile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.collect_timing = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.insecure = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.number_of_retries = 60 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.retry_delay = 1 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.send_service_user_token = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.split_loggers = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.timeout = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.verify_ssl = True {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican.verify_ssl_path = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.auth_section = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.auth_type = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.cafile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.certfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.146s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.collect_timing = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.insecure = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.keyfile = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.split_loggers = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] barbican_service_user.timeout = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.approle_role_id = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.approle_secret_id = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.kv_mountpoint = secret {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.kv_path = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.kv_version = 2 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.namespace = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.root_token_id = **** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.ssl_ca_crt_file = None {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.timeout = 60.0 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.use_ssl = False {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:09:00 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] ******************************************************************************** {{(pid=75436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 13:09:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.108s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:00 devstack sudo[75656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 13:09:00 devstack sudo[75656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:02 devstack sudo[75656]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:02 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.074s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:02 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:03 devstack sudo[75775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:03 devstack sudo[75775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:04 devstack sudo[75775]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:04 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.040s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:04 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:09:04 devstack cinder-volume[75608]: INFO cinder.brick.local_dev.lvm [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 13:09:04 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:05 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:05 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:05 devstack sudo[75869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:09:05 devstack sudo[75869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:07 devstack sudo[75869]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:07 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.975s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:07 devstack cinder-volume[75608]: DEBUG cinder.brick.local_dev.lvm [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75608) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 10 13:09:07 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:07 devstack sudo[75964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:07 devstack sudo[75964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:09 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:09:10 devstack sudo[75964]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:10 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.471s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:10 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:10 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.103s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:10 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:10 devstack sudo[76158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:10 devstack sudo[76158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:12 devstack sudo[76158]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:12 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.069s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:12 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:12 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.083s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:12 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:12 devstack sudo[76195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 13:09:12 devstack sudo[76195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:14 devstack sudo[76195]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:14 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.053s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:14 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:15 devstack sudo[76231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:09:15 devstack sudo[76231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:18 devstack sudo[76231]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:18 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.417s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:18 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:18 devstack sudo[76316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:09:18 devstack sudo[76316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:21 devstack sudo[76316]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:21 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.613s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:21 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:21 devstack sudo[76320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:09:21 devstack sudo[76320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:24 devstack sudo[76320]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:24 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.281s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:24 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:24 devstack sudo[76324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:24 devstack sudo[76324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:26 devstack sudo[76324]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:26 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.412s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:26 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:27 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.118s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:27 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:27 devstack sudo[76331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:27 devstack sudo[76331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:29 devstack sudo[76331]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:29 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.199s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:29 devstack cinder-volume[75608]: INFO cinder.volume.drivers.lvm [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 13:09:29 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:29 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.090s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:29 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:29 devstack sudo[76412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:29 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:31 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:31 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.967s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:31 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:09:31 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:31 devstack sudo[76475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:09:31 devstack sudo[76475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:33 devstack sudo[76475]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:33 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.042s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:33 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:33 devstack sudo[76593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:09:33 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:35 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.559s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:36 devstack sudo[76597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:36 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:38 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.091s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:38 devstack sudo[76602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:09:38 devstack sudo[76602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:40 devstack sudo[76602]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.209s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:40 devstack cinder-volume[75608]: INFO cinder.volume.driver [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Driver hasn't implemented _init_vendor_properties() Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG cinder.volume.driver [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75608) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG oslo_db.sqlalchemy.engines [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writer thread running {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG cinder.db.sqlalchemy.api [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Building query based on filter {{(pid=75608) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG cinder.image.image_utils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75608) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 13:09:40 devstack cinder-volume[75608]: INFO cinder.keymgr.migration [None req-a68264a0-35a0-4f3a-85c6-eeaa6e725409 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:09:40 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:41 devstack sudo[76608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:09:41 devstack sudo[76608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:42 devstack sudo[76608]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:43 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.086s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:43 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:43 devstack sudo[76646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:09:43 devstack sudo[76646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:45 devstack sudo[76646]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:45 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.111s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:45 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:45 devstack sudo[76756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:45 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:47 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:47 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.062s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:47 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:47 devstack sudo[76760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:09:47 devstack sudo[76760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:49 devstack sudo[76760]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:49 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.934s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:49 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:09:49 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Driver initialization completed successfully. Sep 10 13:09:49 devstack cinder-volume[75608]: INFO cinder.manager [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Initiating service 2 cleanup Sep 10 13:09:49 devstack cinder-volume[75608]: INFO cinder.manager [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Service 2 cleanup completed. Sep 10 13:09:49 devstack cinder-volume[75608]: DEBUG cinder.service [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Creating RPC server for service cinder-volume {{(pid=75608) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 13:09:49 devstack cinder-volume[75608]: DEBUG cinder.service [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75608) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 13:09:49 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 13:09:49 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:09:49 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:49 devstack sudo[76763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:09:49 devstack sudo[76763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:51 devstack sudo[76763]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:51 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.966s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:51 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:51 devstack sudo[76771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:09:51 devstack sudo[76771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:53 devstack sudo[76771]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:53 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.032s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:53 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:53 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:09:53 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:55 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:55 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.972s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:55 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:09:55 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:09:55 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:09:58 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 10 13:09:58 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.390s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:09:58 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-a68e3b8f-36fe-4ebd-bb03-5466884c7a3e None None] Driver post RPC initialization completed successfully. Sep 10 13:09:59 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:10:08 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:10:48 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:10:48 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:10:48 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:10:48 devstack sudo[77772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:10:48 devstack sudo[77772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:10:50 devstack sudo[77772]: pam_unix(sudo:session): session closed for user root Sep 10 13:10:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.027s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:10:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:10:50 devstack sudo[77775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:10:50 devstack sudo[77775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:10:52 devstack sudo[77775]: pam_unix(sudo:session): session closed for user root Sep 10 13:10:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.969s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:10:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:10:52 devstack sudo[77822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:10:52 devstack sudo[77822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:10:54 devstack sudo[77822]: pam_unix(sudo:session): session closed for user root Sep 10 13:10:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.096s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:10:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:10:54 devstack sudo[77918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:10:54 devstack sudo[77918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:10:56 devstack sudo[77918]: pam_unix(sudo:session): session closed for user root Sep 10 13:10:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.133s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:10:56 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:11:48 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:11:48 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:11:48 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:11:48 devstack sudo[78544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:11:48 devstack sudo[78544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:11:50 devstack sudo[78544]: pam_unix(sudo:session): session closed for user root Sep 10 13:11:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.972s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:11:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:11:50 devstack sudo[78547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:11:50 devstack sudo[78547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:11:52 devstack sudo[78547]: pam_unix(sudo:session): session closed for user root Sep 10 13:11:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.930s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:11:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:11:52 devstack sudo[78569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:11:52 devstack sudo[78569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:11:54 devstack sudo[78569]: pam_unix(sudo:session): session closed for user root Sep 10 13:11:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.973s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:11:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:11:54 devstack sudo[78580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:11:54 devstack sudo[78580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:11:56 devstack sudo[78580]: pam_unix(sudo:session): session closed for user root Sep 10 13:11:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.012s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:11:56 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:12:08 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:12:48 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:12:48 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:12:48 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:12:48 devstack sudo[80739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:12:48 devstack sudo[80739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:12:50 devstack sudo[80739]: pam_unix(sudo:session): session closed for user root Sep 10 13:12:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.072s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:12:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:12:50 devstack sudo[80892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:12:50 devstack sudo[80892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:12:52 devstack sudo[80892]: pam_unix(sudo:session): session closed for user root Sep 10 13:12:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.994s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:12:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:12:52 devstack sudo[81038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:12:52 devstack sudo[81038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:12:54 devstack sudo[81038]: pam_unix(sudo:session): session closed for user root Sep 10 13:12:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.029s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:12:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:12:54 devstack sudo[81190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:12:54 devstack sudo[81190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:12:56 devstack sudo[81190]: pam_unix(sudo:session): session closed for user root Sep 10 13:12:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.019s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:12:56 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:13:48 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:13:48 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:13:48 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:13:48 devstack sudo[81834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:13:48 devstack sudo[81834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:13:50 devstack sudo[81834]: pam_unix(sudo:session): session closed for user root Sep 10 13:13:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.992s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:13:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:13:50 devstack sudo[81838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:13:50 devstack sudo[81838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:13:52 devstack sudo[81838]: pam_unix(sudo:session): session closed for user root Sep 10 13:13:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.010s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:13:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:13:52 devstack sudo[81843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:13:52 devstack sudo[81843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:13:54 devstack sudo[81843]: pam_unix(sudo:session): session closed for user root Sep 10 13:13:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.021s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:13:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:13:54 devstack sudo[81849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:13:54 devstack sudo[81849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:13:56 devstack sudo[81849]: pam_unix(sudo:session): session closed for user root Sep 10 13:13:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.859s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:13:56 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:14:08 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:14:08 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:14:48 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:14:48 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 13:14:48 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:14:48 devstack sudo[82040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 13:14:48 devstack sudo[82040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:14:50 devstack sudo[82040]: pam_unix(sudo:session): session closed for user root Sep 10 13:14:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.114s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:14:50 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:14:50 devstack sudo[82046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:14:50 devstack sudo[82046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:14:52 devstack sudo[82046]: pam_unix(sudo:session): session closed for user root Sep 10 13:14:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.888s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:14:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:14:52 devstack sudo[82051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 13:14:52 devstack sudo[82051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:14:54 devstack sudo[82051]: pam_unix(sudo:session): session closed for user root Sep 10 13:14:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.924s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:14:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:14:54 devstack sudo[82066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 13:14:54 devstack sudo[82066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:14:56 devstack sudo[82066]: pam_unix(sudo:session): session closed for user root Sep 10 13:14:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.710s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:14:56 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-79bb516b-53c1-4fbd-ac9c-f6beec76f1f8 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:15:37 devstack cinder-volume[75436]: INFO oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Caught SIGTERM, stopping children Sep 10 13:15:37 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Acquiring lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 13:15:37 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Acquired lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 13:15:37 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Releasing lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 13:15:37 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Stop services. {{(pid=75436) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 10 13:15:37 devstack cinder-volume[75436]: DEBUG oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Killing children. {{(pid=75436) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 10 13:15:37 devstack cinder-volume[75436]: INFO oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Waiting on 1 children to exit Sep 10 13:15:39 devstack cinder-volume[75608]: DEBUG oslo_concurrency.lockutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Acquiring lock "singleton_lock" {{(pid=75608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 13:15:39 devstack cinder-volume[75608]: DEBUG oslo_concurrency.lockutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Acquired lock "singleton_lock" {{(pid=75608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 13:15:39 devstack cinder-volume[75608]: DEBUG oslo_concurrency.lockutils [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Releasing lock "singleton_lock" {{(pid=75608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 13:15:39 devstack cinder-volume[75608]: WARNING amqp [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 13:15:39 devstack cinder-volume[75608]: WARNING amqp [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 13:15:39 devstack cinder-volume[75436]: INFO oslo_service.backend._eventlet.service [None req-7561fc90-37e2-445e-957d-d1823a4e4889 None None] Child 75608 exited with status 0 Sep 10 13:15:57 devstack cinder-volume[82999]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82999) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 13:15:57 devstack cinder-volume[82999]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82999) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 13:15:57 devstack cinder-volume[82999]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82999) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 13:16:01 devstack cinder-volume[82999]: INFO dbcounter [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Registered counter for database cinder Sep 10 13:16:01 devstack cinder-volume[82999]: DEBUG oslo_db.sqlalchemy.engines [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG dbcounter [-] [82999] Writer thread running {{(pid=82999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 13:16:02 devstack cinder-volume[82999]: INFO cinder.rpc [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 13:16:02 devstack cinder-volume[82999]: INFO cinder.rpc [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_db.sqlalchemy.engines [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:16:02 devstack cinder-volume[82999]: INFO cinder.volume.manager [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Determined volume DB was empty at startup. Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG cinder.volume.manager [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82999) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 13:16:02 devstack cinder-volume[82999]: INFO cinder.volume.manager [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 13:16:02 devstack cinder-volume[82999]: WARNING stevedore.named [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 13:16:02 devstack cinder-volume[82999]: WARNING castellan.key_manager [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 13:16:02 devstack cinder-volume[82999]: WARNING cinder.keymgr.conf_key_mgr [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 13:16:02 devstack cinder-volume[82999]: INFO cinder.volume.manager [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_db.sqlalchemy.engines [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:16:02 devstack cinder-volume[82999]: INFO oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Starting 1 workers Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Started child 83206 {{(pid=82999) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Full set of CONF: {{(pid=82999) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 13:16:02 devstack cinder-volume[83206]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] ******************************************************************************** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Configuration options gathered from: {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] ================================================================================ {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] allow_availability_zone_fallback = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] allow_compression_on_image_upload = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] allowed_direct_url_schemes = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:02 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] api_rate_limit = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] auth_strategy = keystone {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_availability_zone = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_host = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_stats_polling_interval = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backup_api_class = cinder.backup.api.API {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backup_name_template = backup-%s {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backup_use_same_host = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backup_use_temp_snapshot = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] chap_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] chap_username = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_internal_tenant_project_id = 8493c00625a04fb086f181a0a12fe007 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_internal_tenant_user_id = da11d2e090db47858702ec60b144e4c1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cluster = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] compression_format = gzip {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] compute_api_class = cinder.compute.nova.API {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] config_dir = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] config_source = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] control_exchange = openstack {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] debug = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] default_availability_zone = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] default_group_type = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] default_volume_type = QuobyteHD {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] driver_client_cert = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] driver_client_cert_key = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] driver_data_namespace = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] driver_ssl_cert_path = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] driver_ssl_cert_verify = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] driver_use_ssl = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] enable_new_services = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] enable_unsupported_driver = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] enabled_backends = ['QuobyteHD'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] enforce_multipath_for_image_xfer = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] filter_function = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_api_insecure = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_api_servers = ['http://192.168.122.43/image'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_api_ssl_compression = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_ca_certificates_file = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_catalog_info = image:glance:publicURL {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_num_retries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance_request_timeout = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] goodness_function = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] graceful_shutdown_timeout = 5 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] group_api_class = cinder.group.api.API {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] host = devstack {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_compress_on_upload = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_conversion_address_space_limit = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_conversion_cpu_limit = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_conversion_disable = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_upload_use_cinder_backend = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_upload_use_internal_tenant = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_volume_cache_enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_volume_cache_max_count = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] image_volume_cache_max_size_gb = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] init_host_max_objects_retrieval = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] instance_format = [instance: %(uuid)s] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] iscsi_iotype = fileio {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] iscsi_target_flags = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] iscsi_write_cache = on {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] iser_helper = tgtadm {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] iser_ip_address = 192.168.122.43 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] iser_port = 3260 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_color = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_config_append = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_dir = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_file = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_options = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_rotate_interval = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_rotate_interval_type = days {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] log_rotation_type = none {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] max_age = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] max_logfile_count = 30 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] max_logfile_size_mb = 200 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] max_over_subscription_ratio = 20.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] message_reap_interval = 86400 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] message_ttl = 2592000 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] migration_create_volume_timeout_secs = 300 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] monkey_patch = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] monkey_patch_modules = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] my_ip = 192.168.122.43 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] no_snapshot_gb_quota = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] num_iser_scan_tries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] num_shell_tries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] num_volume_device_scan_tries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] nvmeof_conn_info_version = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] nvmet_ns_id = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] nvmet_port_id = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] osapi_max_limit = 1000 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] osapi_volume_ext_list = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] osapi_volume_listen_port = 8776 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] osapi_volume_use_ssl = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] osapi_volume_workers = 2 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] per_volume_size_limit = -1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] periodic_fuzzy_delay = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] periodic_interval = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] public_endpoint = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] publish_errors = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] quota_backup_gigabytes = 1000 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] quota_backups = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] quota_gigabytes = 1000 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] quota_groups = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] quota_snapshots = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] quota_volumes = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] rate_limit_burst = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] rate_limit_except_level = CRITICAL {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] rate_limit_interval = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] reinit_driver_count = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] replication_device = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] report_discard_supported = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] report_interval = 120 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] reservation_clean_interval = 86400 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] reservation_expire = 86400 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] reserved_image_namespaces = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] reserved_percentage = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] rpc_response_timeout = 120 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] run_external_periodic_tasks = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] scst_target_driver = iscsi {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] scst_target_iqn_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_down_time = 720 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] shell_completion = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] snapshot_name_template = snapshot-%s {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] split_loggers = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] state_path = /opt/stack/data/cinder {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] storage_availability_zone = nova {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] storage_protocol = iSCSI {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] syslog_log_facility = LOG_USER {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] target_helper = lioadm {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] target_ip_address = 192.168.122.43 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] target_port = 3260 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] target_protocol = iscsi {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] target_secondary_ip_addresses = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] trace_flags = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] transport_url = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] until_refresh = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] use_chap_auth = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] use_default_quota_class = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] use_journal = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] use_json = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] use_multipath_for_image_xfer = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] use_stderr = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] use_syslog = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] verify_glance_signatures = enabled {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_api_class = cinder.volume.api.API {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_backend_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_clear = zero {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_clear_ionice = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_clear_size = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_copy_bps_limit = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_dd_blocksize = 1M {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_name_template = volume-%s {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_service_inithost_offload = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volume_usage_audit_period = month {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] watch_log_file = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] zoning_mode = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_concurrency.disable_process_locking = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.admin_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.admin_token = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.admin_user = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_port = 35357 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_protocol = https {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_section = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_type = password {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_uri = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.auth_version = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.cache = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.identity_uri = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.include_service_catalog = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.insecure = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.interface = public {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_password = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcache_username = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.region_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.service_type = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.backend = dogpile.cache.null {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.backend_argument = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.backend_expiration_time = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.config_prefix = cache.oslo {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.dead_timeout = 60.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.debug_cache_backend = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.enable_retry_client = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.enable_socket_keepalive = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.enforce_fips_mode = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.expiration_time = 600 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.hashclient_retry_attempts = 2 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_dead_retry = 300 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_pool_maxsize = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_sasl_enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.memcache_username = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.proxies = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.redis_db = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.redis_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.redis_server = localhost:6379 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.redis_socket_timeout = 1.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.redis_username = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.retry_attempts = 2 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.retry_delay = 0.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.socket_keepalive_count = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.socket_keepalive_idle = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.socket_keepalive_interval = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.tls_allowed_ciphers = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.tls_cafile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.tls_certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.tls_enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cache.tls_keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] coordination.backend_url = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.asyncio_connection = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.asyncio_slave_connection = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.backend = sqlalchemy {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.connection = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.connection_debug = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.connection_parameters = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.connection_recycle_time = 3600 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.connection_trace = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.db_inc_retry_interval = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.db_max_retries = 20 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.db_max_retry_interval = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.db_retry_interval = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.max_overflow = 50 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.max_pool_size = 5 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.max_retries = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.mysql_wsrep_sync_wait = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.pool_timeout = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.retry_interval = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.slave_connection = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.sqlite_synchronous = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] database.use_db_reconnect = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.connection_string = messaging:// {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.es_doc_type = notification {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.es_scroll_size = 10000 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.es_scroll_time = 2m {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.filter_error_trace = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.hmac_keys = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Starting volume driver QuobyteDriver (1.1.13) Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.sentinel_service_name = mymaster {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.socket_timeout = 0.1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.trace_requests = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83206) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler.trace_sqlalchemy = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler_jaeger.process_tags = {} {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler_jaeger.service_name_prefix = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] profiler_otlp.service_name_prefix = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.enforce_new_defaults = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: WARNING oslo_config.cfg [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.enforce_scope = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.policy_default_rule = default {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.policy_file = policy.yaml {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] privsep_osbrick.group = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] privsep_osbrick.helper_command = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] privsep_osbrick.user = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_sys_admin.group = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_sys_admin.helper_command = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] cinder_sys_admin.user = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.auth_section = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.auth_type = password {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.collect_timing = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.insecure = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.send_service_user_token = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.split_loggers = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] service_user.timeout = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.auth_section = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.auth_type = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.cafile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.collect_timing = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.insecure = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.split_loggers = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] glance.timeout = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.backend_availability_zone = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.chap_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.chap_username = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.driver_client_cert = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.driver_client_cert_key = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.driver_data_namespace = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.driver_use_ssl = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.extra_capabilities = {} {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.filter_function = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.goodness_function = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.iscsi_iotype = fileio {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.iscsi_target_flags = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.iscsi_write_cache = on {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.iser_helper = tgtadm {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.iser_ip_address = 192.168.122.43 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.iser_port = 3260 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_host = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_login = admin {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_mount_options = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_private_key = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_share_path = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.num_shell_tries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.quobyte_volume_url = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.replication_device = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.report_discard_supported = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.reserved_percentage = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.target_helper = tgtadm {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.target_ip_address = 192.168.122.43 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.target_port = 3260 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.target_protocol = iscsi {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.trace_flags = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.unique_fqdn_network = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.use_chap_auth = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_backend_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_clear = zero {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_clear_ionice = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_clear_size = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_reports.file_event_handler = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_reports.log_dir = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.backend_availability_zone = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.backend_host = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.chap_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.chap_username = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.chiscsi_conf = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.driver_client_cert = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.driver_data_namespace = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.driver_use_ssl = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.extra_capabilities = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.filter_function = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.goodness_function = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.iscsi_iotype = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.iser_helper = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.iser_ip_address = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.iser_port = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.iser_target_prefix = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_host = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_login = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_mount_options = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_password = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_private_key = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_share_path = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_ssh_port = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.num_shell_tries = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.nvmet_port_id = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.replication_device = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.report_discard_supported = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.reserved_percentage = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.scst_target_driver = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.storage_protocol = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.target_helper = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.target_ip_address = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.target_port = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.target_prefix = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.target_protocol = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.trace_flags = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.use_chap_auth = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_clear = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_clear_size = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] QuobyteHD.volumes_dir = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.ssl = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_notifications.driver = [] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_notifications.retry = -1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] key_manager.fixed_key = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.barbican_api_version = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.barbican_endpoint = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.barbican_endpoint_type = public {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.barbican_region_name = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.cafile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.collect_timing = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.insecure = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.number_of_retries = 60 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.retry_delay = 1 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.send_service_user_token = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.split_loggers = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.timeout = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.verify_ssl = True {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican.verify_ssl_path = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.auth_section = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.auth_type = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.cafile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.certfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.collect_timing = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.insecure = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.keyfile = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.split_loggers = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] barbican_service_user.timeout = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.approle_role_id = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.approle_secret_id = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.kv_mountpoint = secret {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.kv_path = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.kv_version = 2 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.namespace = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.root_token_id = **** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.ssl_ca_crt_file = None {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.timeout = 60.0 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.use_ssl = False {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 13:16:03 devstack cinder-volume[82999]: DEBUG oslo_service.backend._eventlet.service [None req-b370804f-ea91-4791-848f-3dae0d783ec3 None None] ******************************************************************************** {{(pid=82999) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 13:16:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83206) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 10 13:16:04 devstack cinder-volume[83206]: INFO cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 10 13:16:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Running cmd (subprocess): mount.quobyte {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:16:04 devstack quobyte-client[83249]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 13:16:04 devstack quobyte-client[83249]: Invalid parameters found, error: missing mount point. Sep 10 13:16:04 devstack quobyte-client[83249]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 13:16:04 devstack quobyte-client[83249]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 10 13:16:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] CMD "mount.quobyte" returned: 1 in 0.473s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:16:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:16:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:16:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:16:04 devstack cinder-volume[83206]: INFO cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Mounting volume: 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 ... Sep 10 13:16:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba -c /etc/quobyte/client-cinder.cfg {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:16:04 devstack quobyte-client[83257]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 10 13:16:04 devstack quobyte-client[83257]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 13:16:04 devstack quobyte-client[83257]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba' to display the log. Sep 10 13:16:04 devstack quobyte-client[83260]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 10 13:16:04 devstack quobyte-client[83260]: mount.quobyte 3.25 (4fbbd59204) Sep 10 13:16:04 devstack quobyte-client[83260]: Client UUID: WpIfz74B-Nw1V-c26z-5Rqi-fD9H53RBb4cc Sep 10 13:16:04 devstack quobyte-client[83260]: Registry: osci01.corp.quobyte.com:7861 Sep 10 13:16:04 devstack quobyte-client[83260]: Volume: cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:16:04 devstack quobyte-client[83260]: FUSE version: 316 Sep 10 13:16:04 devstack quobyte-client[83260]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 10 13:16:04 devstack quobyte-client[83260]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 10 13:16:04 devstack quobyte-client[83260]: Setting total object cache size to 3352297472 bytes Sep 10 13:16:04 devstack quobyte-client[83260]: Using FUSE low-level API Sep 10 13:16:04 devstack quobyte-client[83260]: Caching of uid/gid to user/group name mappings is enabled Sep 10 13:16:04 devstack quobyte-client[83260]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 10 13:16:04 devstack quobyte-client[83260]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 10 13:16:04 devstack quobyte-client[83260]: HTTP server started on port 55000 Sep 10 13:16:04 devstack quobyte-client[83260]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 10 13:16:04 devstack quobyte-client[83260]: Mount point /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba established Sep 10 13:16:04 devstack quobyte-client[83260]: TimeSync is running and remote sync every 60 seconds Sep 10 13:16:05 devstack quobyte-client[83260]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 13:16:05 devstack quobyte-client[83260]: Ignored time synchronization message because time source took too long to respond (63 ms) Sep 10 13:16:05 devstack quobyte-client[83260]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 13:16:05 devstack quobyte-client[83260]: Opening volume cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 (9722c971-32f0-4d12-a219-e1a443cac4e1) Sep 10 13:16:05 devstack quobyte-client[83260]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 10 13:16:05 devstack quobyte-client[83260]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 13:16:05 devstack quobyte-client[83260]: Failed to invalidate inode: 38: Function not implemented Sep 10 13:16:05 devstack quobyte-client[83260]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 13:16:05 devstack quobyte-client[83260]: Automatic minidump upload enabled by global system configuration Sep 10 13:16:05 devstack quobyte-client[83260]: Announcing HTTP status server address 172.24.4.1 Sep 10 13:16:05 devstack quobyte-client[83260]: Registered as service (uuid WpIfz74B-Nw1V-c26z-5Rqi-fD9H53RBb4cc) Sep 10 13:16:05 devstack quobyte-client[83260]: Quobyte Client running as pid 83260 Sep 10 13:16:05 devstack quobyte-client[83260]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 10 13:16:05 devstack quobyte-client[83260]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.694s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:16:05 devstack cinder-volume[83206]: INFO cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Mounting volume: 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 succeeded Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.759s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:16:05 devstack quobyte-client[83260]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.089s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:16:05 devstack cinder-volume[83206]: INFO cinder.volume.driver [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Driver hasn't implemented _init_vendor_properties() Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG cinder.volume.driver [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83206) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writer thread running {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG cinder.db.sqlalchemy.api [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Building query based on filter {{(pid=83206) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83206) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 13:16:05 devstack cinder-volume[83206]: INFO cinder.keymgr.migration [None req-d6913ff6-a8bd-461f-9564-b6feb208a69f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:16:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.107s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:16:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Driver initialization completed successfully. Sep 10 13:16:06 devstack cinder-volume[83206]: INFO cinder.manager [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Initiating service 3 cleanup Sep 10 13:16:06 devstack cinder-volume[83206]: INFO cinder.manager [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Service 3 cleanup completed. Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG cinder.service [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Creating RPC server for service cinder-volume {{(pid=83206) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG cinder.service [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83206) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 13:16:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 10 13:16:06 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:16:06 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:16:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.106s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:16:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3bb40864-6799-49f9-892f-03d57dfdfd6a None None] Driver post RPC initialization completed successfully. Sep 10 13:16:07 devstack quobyte-client[83260]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 13:16:12 devstack cinder-volume[82999]: DEBUG dbcounter [-] [82999] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:16:16 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:16:16 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:17:09 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:17:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:17:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:17:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:17:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:17:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:17:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:17:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.173s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:17:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:17:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:17:30 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:17:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Flow 'volume_create_manager' (98fb218a-5a8b-4f05-8d99-c5db1adc2533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd79ce8-f27f-4efc-9308-7f31769dabdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd79ce8-f27f-4efc-9308-7f31769dabdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-737359263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6b797b-e14c-46cd-82c2-546d93d7b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede30b15a0414c5b8897674ca1dbaf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:17:30Z,use_quota=True,user_id='e5e4a741faed42148935aba4a85918ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57c461a-c699-4306-806f-9c6222bf049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57c461a-c699-4306-806f-9c6222bf049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efcf017-411b-4a44-8d0f-8b92defcea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efcf017-411b-4a44-8d0f-8b92defcea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6b797b-e14c-46cd-82c2-546d93d7b78e', 'volume_name': 'volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bede6fa5-d19c-4d5c-b983-f496ee0a2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bede6fa5-d19c-4d5c-b983-f496ee0a2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2db4c35-984c-4454-bd3d-509e9c93f6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:17:31 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume 3b6b797b-e14c-46cd-82c2-546d93d7b78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e', 'volume_size': 1} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-737359263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6b797b-e14c-46cd-82c2-546d93d7b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede30b15a0414c5b8897674ca1dbaf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:17:30Z,use_quota=True,user_id='e5e4a741faed42148935aba4a85918ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Creating volume 3b6b797b-e14c-46cd-82c2-546d93d7b78e {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:17:31 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:17:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:17:31 devstack quobyte-client[83260]: System call of process 83591 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:17:31 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=2, name=volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e 1073741824" returned: 0 in 0.883s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e" returned: 0 in 0.149s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] <== create_volume: return (1113ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2db4c35-984c-4454-bd3d-509e9c93f6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960bad60-dce7-4f76-a30c-96e38f2e73fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:17:32 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e (3b6b797b-e14c-46cd-82c2-546d93d7b78e): created successfully Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960bad60-dce7-4f76-a30c-96e38f2e73fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:17:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Flow 'volume_create_manager' (98fb218a-5a8b-4f05-8d99-c5db1adc2533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:17:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-65c510b6-db3d-4d49-b9e6-fdeeda4cf0bf tempest-VolumesAssistedSnapshotsTest-64037891 None] Created volume successfully. Sep 10 13:17:42 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:17:42 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:18:09 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:18:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:18:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:18:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:18:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:18:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.099s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:18:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:18:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.479s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:18:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:18:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:18:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:18:20 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:18:20 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:18:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Flow 'volume_create_manager' (3ddf195d-6a15-4ea7-b5b2-bdfa47b26327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:18:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0343b5d1-7e5e-4f0e-9c43-6cf6b2082c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0343b5d1-7e5e-4f0e-9c43-6cf6b2082c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1395266894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a064e9-9fb5-4f23-8f58-cc51d09354b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd15f1addee40b7a68bb2450253976e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:18:20Z,use_quota=True,user_id='24c4d61f8ad54c97b6cf3cdb7faf38e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08550d0d-eda0-4705-8090-725b59441f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08550d0d-eda0-4705-8090-725b59441f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55706312-3145-4b1a-9820-8811f21e4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55706312-3145-4b1a-9820-8811f21e4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a064e9-9fb5-4f23-8f58-cc51d09354b6', 'volume_name': 'volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83c335-0349-4388-ba27-dad2446e2b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83c335-0349-4388-ba27-dad2446e2b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7ef13-48be-45a8-9730-eae49c8ca744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:18:22 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Volume d6a064e9-9fb5-4f23-8f58-cc51d09354b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6', 'volume_size': 1} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1395266894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a064e9-9fb5-4f23-8f58-cc51d09354b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd15f1addee40b7a68bb2450253976e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:18:20Z,use_quota=True,user_id='24c4d61f8ad54c97b6cf3cdb7faf38e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Creating volume d6a064e9-9fb5-4f23-8f58-cc51d09354b6 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:18:22 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:18:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:18:22 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=3, name=volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:18:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6 1073741824" returned: 0 in 1.624s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:18:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:18:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6" returned: 0 in 0.447s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:18:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] <== create_volume: return (2684ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:18:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.759s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:18:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7ef13-48be-45a8-9730-eae49c8ca744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:18:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9352b2-f6a0-4e67-93fd-6da6cc0ad25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:18:25 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Volume volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6 (d6a064e9-9fb5-4f23-8f58-cc51d09354b6): created successfully Sep 10 13:18:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9352b2-f6a0-4e67-93fd-6da6cc0ad25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:18:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Flow 'volume_create_manager' (3ddf195d-6a15-4ea7-b5b2-bdfa47b26327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:18:25 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2446f382-9c80-4b4a-b6d9-faeabccb5c29 tempest-VolumesAdminNegativeTest-215639044 None] Created volume successfully. Sep 10 13:18:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Acquiring lock "cinder-d6a064e9-9fb5-4f23-8f58-cc51d09354b6-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:18:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "cinder-d6a064e9-9fb5-4f23-8f58-cc51d09354b6-delete_volume" acquired by "delete_volume" :: waited 0.225s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:18:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:18:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Acquiring lock "cinder-quobyte-d6a064e9-9fb5-4f23-8f58-cc51d09354b6" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:18:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "cinder-quobyte-d6a064e9-9fb5-4f23-8f58-cc51d09354b6" acquired by "delete_volume" :: waited 0.204s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:18:32 devstack cinder-volume[83206]: INFO oslo.privsep.daemon [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp183nq7vx/privsep.sock'] Sep 10 13:18:32 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp183nq7vx/privsep.sock Sep 10 13:18:32 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:18:35 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:18:41 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:18:53 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Sep 10 13:18:53 devstack cinder-volume[83206]: INFO oslo.privsep.daemon [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Spawned new privsep daemon via rootwrap Sep 10 13:18:53 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Accepted privsep connection to /tmp/tmp183nq7vx/privsep.sock {{(pid=83206) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 10 13:18:53 devstack cinder-volume[83206]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 13:18:53 devstack cinder-volume[83206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 13:18:53 devstack cinder-volume[83206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 13:18:53 devstack cinder-volume[83206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84394 Sep 10 13:18:53 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bc9c0a-bdb4-4be0-b5d1-e09ac0f1c85c]: (2,) {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:18:53 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de97831d-deea-4b7b-9646-649f27480bb6]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:18:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:18:55 devstack quobyte-client[83260]: System call of process 84430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:18:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6" returned: 0 in 2.403s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:18:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:18:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d6a064e9-9fb5-4f23-8f58-cc51d09354b6" returned: 0 in 0.467s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:18:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "cinder-quobyte-d6a064e9-9fb5-4f23-8f58-cc51d09354b6" released by "delete_volume" :: held 24.986s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:18:57 devstack cinder-volume[83206]: WARNING cinder.quota [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:18:57 devstack cinder-volume[83206]: WARNING cinder.quota [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:18:57 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Created reservations ['45105885-2841-4e51-be28-719ade92b885', '15efb764-0496-4c24-9149-63f86dbbef51', '1643fbf8-342d-43d0-9314-069e0c54eb54', 'c656bf14-5247-4659-8a3e-468c1556eb72'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:18:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:18:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:18:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:18:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:18:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:18:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:18:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.374s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:18:59 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:19:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Deleted volume successfully. Sep 10 13:19:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-48a90a92-33d9-4a48-9a9b-a06ec1547a29 tempest-VolumesAdminNegativeTest-215639044 None] Lock "cinder-d6a064e9-9fb5-4f23-8f58-cc51d09354b6-delete_volume" released by "delete_volume" :: held 30.818s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:19:08 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:19:09 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:19:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:19:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:19:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:19:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:19:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.086s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:19:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.523s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:19:10 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:19:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:19:31 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:19:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Flow 'volume_create_manager' (64ec1333-c7ee-476f-91c4-47bc32584052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:19:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba8b216-1be6-4ec3-85cf-1403aef782ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba8b216-1be6-4ec3-85cf-1403aef782ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1131424059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afca5bf3-c079-40fe-87ea-fffdfd5acdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f9e275477a4608b44068c14015a66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:19:31Z,use_quota=True,user_id='ea8c5faaa89f4eb1981f46636d3ee0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0ede28-4826-49b0-bff7-3fef836465ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0ede28-4826-49b0-bff7-3fef836465ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12568ca-1db7-4973-a624-3450a7da2576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12568ca-1db7-4973-a624-3450a7da2576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afca5bf3-c079-40fe-87ea-fffdfd5acdba', 'volume_name': 'volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac809a4-f260-49b7-bf82-b3e926037ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac809a4-f260-49b7-bf82-b3e926037ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2f0aa5-6df1-4a8a-99b0-9b1def27f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:32 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Volume afca5bf3-c079-40fe-87ea-fffdfd5acdba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba', 'volume_size': 1} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1131424059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afca5bf3-c079-40fe-87ea-fffdfd5acdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f9e275477a4608b44068c14015a66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:19:31Z,use_quota=True,user_id='ea8c5faaa89f4eb1981f46636d3ee0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Creating volume afca5bf3-c079-40fe-87ea-fffdfd5acdba {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:19:32 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:19:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:32 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=4, name=volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:19:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba 1073741824" returned: 0 in 0.867s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba" returned: 0 in 0.214s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] <== create_volume: return (1323ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:19:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:19:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2f0aa5-6df1-4a8a-99b0-9b1def27f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081c93df-49c5-4761-91c0-be403ca4f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:34 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Volume volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba (afca5bf3-c079-40fe-87ea-fffdfd5acdba): created successfully Sep 10 13:19:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081c93df-49c5-4761-91c0-be403ca4f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Flow 'volume_create_manager' (64ec1333-c7ee-476f-91c4-47bc32584052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:19:34 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a438ddd2-b2af-41f0-bdb5-e828f3c70c0c tempest-ServersNegativeTestJSON-1107533941 None] Created volume successfully. Sep 10 13:19:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Flow 'volume_create_manager' (fdf259b1-a338-4e53-a3e2-b223807201c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c45023-e38f-4671-9d66-46b27ac2767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c45023-e38f-4671-9d66-46b27ac2767d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-544572269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76581ec-ec7c-428b-99ac-a5ea6da3bf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f9e275477a4608b44068c14015a66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:19:37Z,use_quota=True,user_id='ea8c5faaa89f4eb1981f46636d3ee0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124c2bcb-dda9-4a6e-9ba3-f6afdad9dd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124c2bcb-dda9-4a6e-9ba3-f6afdad9dd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86f490d-6291-41ad-9baa-b294580e7c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86f490d-6291-41ad-9baa-b294580e7c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76581ec-ec7c-428b-99ac-a5ea6da3bf16', 'volume_name': 'volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296d3cc7-8775-4b2e-bdc9-29d6ea5d34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296d3cc7-8775-4b2e-bdc9-29d6ea5d34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebccb3f-1d87-4114-b850-a392d6599467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:37 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Volume a76581ec-ec7c-428b-99ac-a5ea6da3bf16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16', 'volume_size': 1} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-544572269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76581ec-ec7c-428b-99ac-a5ea6da3bf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f9e275477a4608b44068c14015a66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:19:37Z,use_quota=True,user_id='ea8c5faaa89f4eb1981f46636d3ee0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Creating volume a76581ec-ec7c-428b-99ac-a5ea6da3bf16 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:19:37 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:19:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:37 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=5, name=volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16 1073741824" returned: 0 in 0.447s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16" returned: 0 in 0.107s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] <== create_volume: return (615ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.629s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebccb3f-1d87-4114-b850-a392d6599467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d645990b-893c-4b30-b8a3-2feea5a322c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:19:38 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Volume volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16 (a76581ec-ec7c-428b-99ac-a5ea6da3bf16): created successfully Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d645990b-893c-4b30-b8a3-2feea5a322c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:19:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Flow 'volume_create_manager' (fdf259b1-a338-4e53-a3e2-b223807201c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:19:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-fb8dc3e2-3cee-45d9-a92a-b6424dc4256b tempest-ServersNegativeTestJSON-1107533941 None] Created volume successfully. Sep 10 13:19:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "cinder-a76581ec-ec7c-428b-99ac-a5ea6da3bf16-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:19:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-a76581ec-ec7c-428b-99ac-a5ea6da3bf16-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:19:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:19:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "cinder-quobyte-a76581ec-ec7c-428b-99ac-a5ea6da3bf16" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:19:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-quobyte-a76581ec-ec7c-428b-99ac-a5ea6da3bf16" acquired by "delete_volume" :: waited 0.021s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:19:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b88f7d-30f4-4ff7-9869-f2be8ed690b2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:19:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16" returned: 0 in 0.573s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a76581ec-ec7c-428b-99ac-a5ea6da3bf16" returned: 0 in 0.186s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-quobyte-a76581ec-ec7c-428b-99ac-a5ea6da3bf16" released by "delete_volume" :: held 0.973s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Created reservations ['2510b093-a714-43fe-a049-44275592101c', '70495b3a-68e4-4075-8ba0-26f1622bb119', 'c4af7ca1-abbe-43b6-ad4e-a4413236847b', 'd7f54980-4b0c-4702-8aac-cbe129a47894'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.117s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:19:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Deleted volume successfully. Sep 10 13:19:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4d0acfba-8306-4d53-981d-a12f8ef01f2d tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-a76581ec-ec7c-428b-99ac-a5ea6da3bf16-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "cinder-afca5bf3-c079-40fe-87ea-fffdfd5acdba-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-afca5bf3-c079-40fe-87ea-fffdfd5acdba-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:19:43 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "cinder-quobyte-afca5bf3-c079-40fe-87ea-fffdfd5acdba" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-quobyte-afca5bf3-c079-40fe-87ea-fffdfd5acdba" acquired by "delete_volume" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244e6c5-3cff-4141-a033-8fbf691cf40e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba" returned: 0 in 0.557s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afca5bf3-c079-40fe-87ea-fffdfd5acdba" returned: 0 in 0.091s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-quobyte-afca5bf3-c079-40fe-87ea-fffdfd5acdba" released by "delete_volume" :: held 0.805s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Created reservations ['4762ca9b-f9c2-4df3-af71-5fb25b65a854', 'f11620c0-b126-44c3-aab0-c9248043957f', '88829e96-c978-405d-8a3d-3e846e9d7915', '433d025a-1063-4f53-9680-5f4d3b5769ac'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.140s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:19:44 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:19:44 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Deleted volume successfully. Sep 10 13:19:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-386c34af-70a0-4bc6-802e-7059ffa1018f tempest-ServersNegativeTestJSON-1107533941 None] Lock "cinder-afca5bf3-c079-40fe-87ea-fffdfd5acdba-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:19:54 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=13,cinder:DELETE=2,cinder:SELECT=8,cinder:INSERT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:19:54 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=16,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:20:09 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:20:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:20:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:20:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:20:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:20:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:20:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:20:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.188s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:20:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:20:16 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:20:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:20:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:20:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[22adb568-32f8-4d7d-9d8d-e2151c95b854]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:20:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:20:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e" returned: 0 in 0.659s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:20:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.755s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:20:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd702baa-a90a-4df9-8766-f467e8184eb1', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:20:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:20:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-c524822f-6e5d-4c6d-8312-57b7c076812f req-e28691e1-1ff8-488f-8505-4e885201a6cc tempest-VolumesAssistedSnapshotsTest-64037891 None] attachment_update completed successfully. Sep 10 13:20:37 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:20:37 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:20:56 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Flow 'volume_create_manager' (ed21335f-ad33-4153-9d70-3f26e32fb2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427e4b90-ee3b-42ea-9a69-cee38148dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427e4b90-ee3b-42ea-9a69-cee38148dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1206147166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c600c054-32f4-4518-89ff-5839d0888ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6fe192e0ea4832a66a500a2c2e45e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:20:56Z,use_quota=True,user_id='67fcf585d4af41c9a72dddb985d75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc8959f-5b61-4117-bb80-c3667755c270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc8959f-5b61-4117-bb80-c3667755c270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9edbf0-d777-4f0b-a25c-f43f8e0f8851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9edbf0-d777-4f0b-a25c-f43f8e0f8851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c600c054-32f4-4518-89ff-5839d0888ae6', 'volume_name': 'volume-c600c054-32f4-4518-89ff-5839d0888ae6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56c0dc8-7d52-4fb4-808f-00e3320cfba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56c0dc8-7d52-4fb4-808f-00e3320cfba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80734e1-b456-4333-a92c-35f1e415c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:20:56 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Volume c600c054-32f4-4518-89ff-5839d0888ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c600c054-32f4-4518-89ff-5839d0888ae6', 'volume_size': 1} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1206147166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c600c054-32f4-4518-89ff-5839d0888ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6fe192e0ea4832a66a500a2c2e45e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:20:56Z,use_quota=True,user_id='67fcf585d4af41c9a72dddb985d75d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Creating volume c600c054-32f4-4518-89ff-5839d0888ae6 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:20:56 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:20:56 devstack quobyte-client[83260]: System call of process 85402 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:20:56 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=6, name=volume-c600c054-32f4-4518-89ff-5839d0888ae6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6 1073741824" returned: 0 in 0.607s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:20:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:20:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6" returned: 0 in 0.227s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:20:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] <== create_volume: return (904ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:20:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:20:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80734e1-b456-4333-a92c-35f1e415c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c600c054-32f4-4518-89ff-5839d0888ae6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:20:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f04f3b-e740-47f1-b807-0f6235ca8b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:20:57 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Volume volume-c600c054-32f4-4518-89ff-5839d0888ae6 (c600c054-32f4-4518-89ff-5839d0888ae6): created successfully Sep 10 13:20:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f04f3b-e740-47f1-b807-0f6235ca8b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:20:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Flow 'volume_create_manager' (ed21335f-ad33-4153-9d70-3f26e32fb2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:20:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-41a4f58e-9dc1-4970-88a3-328a24d9b215 tempest-DeleteServersTestJSON-1170302379 None] Created volume successfully. Sep 10 13:20:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-436449d3-e843-4ea4-84bc-f1041db6612c req-55b23e3a-1471-44f6-ae72-567e9fa12c23 tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-436449d3-e843-4ea4-84bc-f1041db6612c req-55b23e3a-1471-44f6-ae72-567e9fa12c23 tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-436449d3-e843-4ea4-84bc-f1041db6612c req-55b23e3a-1471-44f6-ae72-567e9fa12c23 tempest-VolumesAssistedSnapshotsTest-64037891 None] Terminate volume connection completed successfully. Sep 10 13:21:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-436449d3-e843-4ea4-84bc-f1041db6612c req-55b23e3a-1471-44f6-ae72-567e9fa12c23 tempest-VolumesAssistedSnapshotsTest-64037891 None] Deleting attachment cd702baa-a90a-4df9-8766-f467e8184eb1. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:21:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Acquiring lock "cinder-3b6b797b-e14c-46cd-82c2-546d93d7b78e-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:21:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "cinder-3b6b797b-e14c-46cd-82c2-546d93d7b78e-delete_volume" acquired by "delete_volume" :: waited 0.305s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:21:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Acquiring lock "cinder-quobyte-3b6b797b-e14c-46cd-82c2-546d93d7b78e" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:21:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "cinder-quobyte-3b6b797b-e14c-46cd-82c2-546d93d7b78e" acquired by "delete_volume" :: waited 0.034s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:21:04 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473fc1e-a94e-4dd6-956e-09d0c5c29b43]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:21:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:21:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.080s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:21:06 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f74eb8f-283f-4079-9295-ee3fac27204e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:21:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:08 devstack quobyte-client[83260]: System call of process 85478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:21:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e" returned: 0 in 3.339s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3b6b797b-e14c-46cd-82c2-546d93d7b78e" returned: 0 in 0.364s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "cinder-quobyte-3b6b797b-e14c-46cd-82c2-546d93d7b78e" released by "delete_volume" :: held 4.682s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:21:09 devstack quobyte-client[83260]: System call of process 85483 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:21:09 devstack quobyte-client[83260]: System call of process 85483 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:21:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6" returned: 0 in 3.215s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.485s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:21:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:21:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:21:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:21:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:21:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:21:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:21:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 1.383s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:21:11 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-c600c054-32f4-4518-89ff-5839d0888ae6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5d0e3cd-3c62-45d1-8565-19c47d9d5fe4', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:21:11 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:12 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Created reservations ['d2dc2906-9755-46ff-9d86-f111ed7ba853', 'f660dcea-4493-48bf-ab24-238277a090c4', '486cb54e-2051-4982-886f-d11f707848d9', 'b43c1106-fdc3-4c05-8d06-606025bd83ef'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:21:12 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-c70d3787-f08b-462f-b6ba-50f3479bba43 req-949e1675-7806-4ca8-859b-50e81bf5d2c0 tempest-DeleteServersTestJSON-1170302379 None] attachment_update completed successfully. Sep 10 13:21:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:21:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:21:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:21:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:21:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:21:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.344s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:13 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:21:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Deleted volume successfully. Sep 10 13:21:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-eca53dc1-718c-4560-b169-5efdbb8594ec tempest-VolumesAssistedSnapshotsTest-64037891 None] Lock "cinder-3b6b797b-e14c-46cd-82c2-546d93d7b78e-delete_volume" released by "delete_volume" :: held 11.472s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:21:22 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=14,cinder:SELECT=9,cinder:INSERT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:21:25 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=16,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:21:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-275a1d98-1d4f-4295-93c1-008e888c861b req-04648298-b7ab-4713-a66f-fa6523a978f5 tempest-DeleteServersTestJSON-1170302379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-275a1d98-1d4f-4295-93c1-008e888c861b req-04648298-b7ab-4713-a66f-fa6523a978f5 tempest-DeleteServersTestJSON-1170302379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-275a1d98-1d4f-4295-93c1-008e888c861b req-04648298-b7ab-4713-a66f-fa6523a978f5 tempest-DeleteServersTestJSON-1170302379 None] Terminate volume connection completed successfully. Sep 10 13:21:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-275a1d98-1d4f-4295-93c1-008e888c861b req-04648298-b7ab-4713-a66f-fa6523a978f5 tempest-DeleteServersTestJSON-1170302379 None] Deleting attachment a5d0e3cd-3c62-45d1-8565-19c47d9d5fe4. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:21:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Acquiring lock "cinder-c600c054-32f4-4518-89ff-5839d0888ae6-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:21:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Lock "cinder-c600c054-32f4-4518-89ff-5839d0888ae6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:21:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Acquiring lock "cinder-quobyte-c600c054-32f4-4518-89ff-5839d0888ae6" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:21:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Lock "cinder-quobyte-c600c054-32f4-4518-89ff-5839d0888ae6" acquired by "delete_volume" :: waited 0.054s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:21:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c60633-502f-4390-aabd-ab90f3d55984]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:21:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6" returned: 0 in 0.563s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c600c054-32f4-4518-89ff-5839d0888ae6" returned: 0 in 0.342s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Lock "cinder-quobyte-c600c054-32f4-4518-89ff-5839d0888ae6" released by "delete_volume" :: held 1.208s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:21:41 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Created reservations ['0394bca9-afdb-463d-ab12-be2b2049e2a9', 'cf27a27c-eec7-42ad-9961-dd7ed54f5701', '3802b2ba-2663-454f-913c-3a8feebec8a0', 'ff5b8573-6621-44ad-877b-9a7fe1b160c5'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.121s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:21:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Deleted volume successfully. Sep 10 13:21:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36cf8142-e785-4208-aa68-c0a86d33d99e tempest-DeleteServersTestJSON-1170302379 None] Lock "cinder-c600c054-32f4-4518-89ff-5839d0888ae6-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:21:52 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:21:52 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:21:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Flow 'volume_create_manager' (adcbd4f0-1aec-4aa8-a750-6f5475c95baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c70856-f13a-4fcf-b9bd-626aa7661806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c70856-f13a-4fcf-b9bd-626aa7661806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1939278728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbe4d48-5e59-4c40-89d8-da4fbd71ee71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc0af6e2d7834f228a4814c86ec8e9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:21:59Z,use_quota=True,user_id='22b6154ca3ee45adb0ff8863ba2aae79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d959ce2-2204-4f7d-83f5-3e63555e6247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d959ce2-2204-4f7d-83f5-3e63555e6247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091019b-0ac2-4ee3-a27a-e5c8ed1a4753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091019b-0ac2-4ee3-a27a-e5c8ed1a4753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbe4d48-5e59-4c40-89d8-da4fbd71ee71', 'volume_name': 'volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b79081-cf0a-4925-b541-ed78a7b828c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b79081-cf0a-4925-b541-ed78a7b828c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ab3a4d-ff55-486f-8e25-21cb967368f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:21:59 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Volume 9bbe4d48-5e59-4c40-89d8-da4fbd71ee71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71', 'volume_size': 1} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1939278728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbe4d48-5e59-4c40-89d8-da4fbd71ee71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc0af6e2d7834f228a4814c86ec8e9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:21:59Z,use_quota=True,user_id='22b6154ca3ee45adb0ff8863ba2aae79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Creating volume 9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:21:59 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:21:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:21:59 devstack quobyte-client[83260]: System call of process 86105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:22:00 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=7, name=volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 1073741824" returned: 0 in 0.409s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" returned: 0 in 0.136s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] <== create_volume: return (622ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ab3a4d-ff55-486f-8e25-21cb967368f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d8f9f6-6f23-4cbc-87c3-0c76fcb2c047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:00 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Volume volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 (9bbe4d48-5e59-4c40-89d8-da4fbd71ee71): created successfully Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d8f9f6-6f23-4cbc-87c3-0c76fcb2c047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Flow 'volume_create_manager' (adcbd4f0-1aec-4aa8-a750-6f5475c95baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:22:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-4c4122d5-45be-4df8-828b-19613efbb4ad req-2c9ef01f-1d43-4851-bfd8-1f4e45f500e9 tempest-VolumesSnapshotsTestJSON-1110367528 None] Created volume successfully. Sep 10 13:22:02 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Creating offline snapshot 49c9df20-e158-49d3-8210-64a6b4c6c8e4 of volume 9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:22:03 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e027c4e4-032e-4ded-a455-8bd3f2bb06b8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" returned: 0 in 0.521s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:03 devstack quobyte-client[83260]: System call of process 86114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:22:03 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=8, name=volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:22:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 1G" returned: 0 in 0.351s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "qemu-img rebase -u -b volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4" returned: 0 in 0.221s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4" returned: 0 in 0.114s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4" returned: 0 in 0.130s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.info" returned: 0 in 0.196s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.info" returned: 0 in 0.119s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-10e229ae-071f-4853-9572-e5acf6b9f8dd req-10545b29-0947-41ee-b13f-21cacb45d819 tempest-VolumesSnapshotsTestJSON-1110367528 None] Create snapshot completed successfully Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "cinder-49c9df20-e158-49d3-8210-64a6b4c6c8e4-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-49c9df20-e158-49d3-8210-64a6b4c6c8e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:06 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "cinder-quobyte-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-quobyte-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "cinder-quobyte-49c9df20-e158-49d3-8210-64a6b4c6c8e4" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-quobyte-49c9df20-e158-49d3-8210-64a6b4c6c8e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Deleting offline snapshot 49c9df20-e158-49d3-8210-64a6b4c6c8e4 of volume 9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] snapshot_file for this snap is: volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffa9631-1928-4e95-ba67-cd552c124f9c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:07 devstack quobyte-client[83260]: System call of process 86133 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:22:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4" returned: 0 in 0.725s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:22:07 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5936ee72-0fbc-49ae-ac99-1f4afe3e99fe]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" returned: 0 in 0.652s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4" returned: 0 in 0.270s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71.49c9df20-e158-49d3-8210-64a6b4c6c8e4" returned: 0 in 0.166s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-quobyte-49c9df20-e158-49d3-8210-64a6b4c6c8e4" released by "_delete_snapshot" :: held 2.303s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-quobyte-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" released by "delete_snapshot" :: held 2.341s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:09 devstack cinder-volume[83206]: WARNING cinder.quota [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:22:09 devstack cinder-volume[83206]: DEBUG cinder.quota [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Created reservations ['f1caa031-98fa-4708-bcc6-d0082d26af24', '71b821e9-3672-4875-a75c-8a91ee9c2123', 'bb8502b5-66ca-4b01-b17c-7a746e9e10f2', 'befa7947-2192-4868-856b-47f8ed70e54f'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:22:10 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Delete snapshot completed successfully. Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-9bf42c79-d2e2-4ce7-b1c9-ecf75f72188c req-981f194e-7a86-4575-95b0-48fb3e9a19bc tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-49c9df20-e158-49d3-8210-64a6b4c6c8e4-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.140s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "cinder-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:10 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "cinder-quobyte-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-quobyte-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" acquired by "delete_volume" :: waited 0.031s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:11 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8a835-abc8-478c-a2e6-caf8987e5f34]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" returned: 0 in 0.584s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" returned: 0 in 0.130s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-quobyte-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71" released by "delete_volume" :: held 0.987s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG cinder.quota [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Created reservations ['352ff362-c26d-4a8e-9bd8-01d07f7aaaa0', 'fc3f6cee-6e0b-42a7-b496-c90c1621c556', '8ed63bf8-868c-4d8d-ab5d-ae715d377a15', '9cdbffbc-85ac-4950-8b4d-060395cbdb6d'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.135s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:12 devstack cinder-volume[83206]: DEBUG cinder.manager [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:22:12 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Deleted volume successfully. Sep 10 13:22:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-ea930e9e-c26a-4770-8af7-7402584849da req-698feab1-37d0-429b-bd6c-b19d643225f5 tempest-VolumesSnapshotsTestJSON-1110367528 None] Lock "cinder-9bbe4d48-5e59-4c40-89d8-da4fbd71ee71-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:22 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=18,cinder:DELETE=2,cinder:SELECT=10,cinder:INSERT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:22:23 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:22:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-670eaee7-702a-4ec0-9138-6148c3026bb7 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-670eaee7-702a-4ec0-9138-6148c3026bb7 tempest-GroupSnapshotsTest-120634042 None] Group tempest-GroupSnapshotsTest-Group-855536608: creating Sep 10 13:22:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-670eaee7-702a-4ec0-9138-6148c3026bb7 tempest-GroupSnapshotsTest-120634042 None] Group tempest-GroupSnapshotsTest-Group-855536608: created successfully Sep 10 13:22:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-670eaee7-702a-4ec0-9138-6148c3026bb7 tempest-GroupSnapshotsTest-120634042 None] Create group completed successfully. Sep 10 13:22:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (577802b5-2272-4f42-9e40-50a590381f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47345dc-536b-4315-a4e6-82b3e07fa9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47345dc-536b-4315-a4e6-82b3e07fa9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201754115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5b0e499-4d18-49ef-b583-c0a05a2e4da7,host='devstack@QuobyteHD#QuobyteHD',id=9e8684d3-c9e0-4af3-a2e8-07c812bb78ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:22:30Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cea427d-fa1c-45e9-a2c9-4f8e18a08044),volume_type_id=8cea427d-fa1c-45e9-a2c9-4f8e18a08044)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ae15a-d44f-4b9b-865c-8b7ea147203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ae15a-d44f-4b9b-865c-8b7ea147203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66254f2f-3bd5-480c-864c-7cff4ad5d89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66254f2f-3bd5-480c-864c-7cff4ad5d89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8684d3-c9e0-4af3-a2e8-07c812bb78ef', 'volume_name': 'volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08dbaf8-7a49-4288-be5b-0240ae766eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08dbaf8-7a49-4288-be5b-0240ae766eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83509ac-d5cd-4902-b556-b652f7cfa1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:30 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Volume 9e8684d3-c9e0-4af3-a2e8-07c812bb78ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef', 'volume_size': 1} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b5b0e499-4d18-49ef-b583-c0a05a2e4da7,created_at=2025-09-10T11:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201754115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5b0e499-4d18-49ef-b583-c0a05a2e4da7,host='devstack@QuobyteHD#QuobyteHD',id=9e8684d3-c9e0-4af3-a2e8-07c812bb78ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:22:30Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cea427d-fa1c-45e9-a2c9-4f8e18a08044),volume_type_id=8cea427d-fa1c-45e9-a2c9-4f8e18a08044)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Creating volume 9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:22:30 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:30 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=10, name=volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef 1073741824" returned: 0 in 0.357s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" returned: 0 in 0.126s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] <== create_volume: return (552ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83509ac-d5cd-4902-b556-b652f7cfa1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e251e2-ed3e-43b3-acbb-0b1947346078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:31 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Volume volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef (9e8684d3-c9e0-4af3-a2e8-07c812bb78ef): created successfully Sep 10 13:22:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e251e2-ed3e-43b3-acbb-0b1947346078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (577802b5-2272-4f42-9e40-50a590381f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:22:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3ba2ad39-d5bf-49cc-8889-d9ed73868248 tempest-GroupSnapshotsTest-120634042 None] Created volume successfully. Sep 10 13:22:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] GroupSnapshot 1391cb67-22fd-4bfa-b50b-d387c9b2cab8: creating. Sep 10 13:22:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Group snapshot 1391cb67-22fd-4bfa-b50b-d387c9b2cab8: creating. {{(pid=83206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 13:22:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Creating offline snapshot 906b2398-132f-4f63-93de-8c1c01089e8a of volume 9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:22:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4922911f-093a-45c6-8467-227ed6942ff8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" returned: 0 in 0.668s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:32 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=11, name=volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a 1G" returned: 0 in 0.550s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Flow 'volume_create_manager' (52439428-6da1-4dea-bc31-0239fdb744c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30122f45-5a35-4697-b0d0-e7f6105df21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img rebase -u -b volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a" returned: 0 in 0.487s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30122f45-5a35-4697-b0d0-e7f6105df21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-274339098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb52e624818c4bb4a324b676f53033e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:22:33Z,use_quota=True,user_id='737be8267e77422e9d0b6e46f58915ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa382a6-97d3-4b50-9019-87954322e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa382a6-97d3-4b50-9019-87954322e18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef01c656-11a5-4ec4-a3a1-39baa1761fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef01c656-11a5-4ec4-a3a1-39baa1761fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca', 'volume_name': 'volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae46b66b-3675-45fa-bc05-954fa7222f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae46b66b-3675-45fa-bc05-954fa7222f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4188239-50f0-4343-8500-1aab8dcbff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:34 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca', 'volume_size': 1} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a" returned: 0 in 0.291s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.info" returned: 0 in 0.091s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.info" returned: 0 in 0.126s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-274339098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb52e624818c4bb4a324b676f53033e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:22:33Z,use_quota=True,user_id='737be8267e77422e9d0b6e46f58915ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Creating volume ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:22:34 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:22:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:35 devstack quobyte-client[83260]: System call of process 86223 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:22:35 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=13, name=volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:22:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca 1073741824" returned: 0 in 0.675s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca" returned: 0 in 0.317s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] <== create_volume: return (1048ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:22:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4188239-50f0-4343-8500-1aab8dcbff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e3bc9f-2aee-49d1-af9e-033c6a18549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:22:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-072fda4f-73e6-46ef-910c-d8638f38883f tempest-GroupSnapshotsTest-120634042 None] group_snapshot 1391cb67-22fd-4bfa-b50b-d387c9b2cab8: created successfully Sep 10 13:22:36 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca (ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca): created successfully Sep 10 13:22:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e3bc9f-2aee-49d1-af9e-033c6a18549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:22:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Flow 'volume_create_manager' (52439428-6da1-4dea-bc31-0239fdb744c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:22:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-560d0105-4531-4b34-b520-cc02f1c22fa5 tempest-AttachVolumeShelveTestJSON-1870643907 None] Created volume successfully. Sep 10 13:22:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-906b2398-132f-4f63-93de-8c1c01089e8a-e09dc32d-90f8-4204-afa5-d798810f7736" by "_create_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-906b2398-132f-4f63-93de-8c1c01089e8a-e09dc32d-90f8-4204-afa5-d798810f7736" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Creating volume e09dc32d-90f8-4204-afa5-d798810f7736 from snapshot 906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-e09dc32d-90f8-4204-afa5-d798810f7736" by "_copy_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-e09dc32d-90f8-4204-afa5-d798810f7736" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] snapshot: 906b2398-132f-4f63-93de-8c1c01089e8a, volume: e09dc32d-90f8-4204-afa5-d798810f7736, {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc039e9-c7d3-41fa-8005-21cf90cf0b5a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a" returned: 0 in 0.519s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 13:22:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Creating direct copy from snapshot {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 13:22:39 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad19ea57-be2d-484a-9e3a-ff6c98456832]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" returned: 0 in 0.739s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:39 devstack cinder-volume[83206]: DEBUG cinder.utils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736 not found in is_blk_device check {{(pid=83206) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 13:22:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:40 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=14, name=volume-e09dc32d-90f8-4204-afa5-d798810f7736, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:22:48 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:22:49 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:22:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736" returned: 0 in 11.876s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da01ed8-d515-475a-8f4e-f5161f60eb9e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" returned: 0 in 1.122s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:52 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Image conversion details: src /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef, size 1024.00 MB, duration 11.89 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736 {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:22:52 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Converted 1024.00 MB image at 86.11 MB/s Sep 10 13:22:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:22:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736" returned: 0 in 0.226s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-e09dc32d-90f8-4204-afa5-d798810f7736" released by "_copy_volume_from_snapshot" :: held 15.149s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-906b2398-132f-4f63-93de-8c1c01089e8a-e09dc32d-90f8-4204-afa5-d798810f7736" released by "_create_volume_from_snapshot" :: held 15.189s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.255s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d09c8cba-8b72-4086-8fa2-eb5516b2a125 tempest-GroupSnapshotsTest-120634042 None] Create group from source-snapshot-1391cb67-22fd-4bfa-b50b-d387c9b2cab8 completed successfully. Sep 10 13:22:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-e09dc32d-90f8-4204-afa5-d798810f7736" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-e09dc32d-90f8-4204-afa5-d798810f7736" acquired by "delete_volume" :: waited 0.033s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca8fbfd-b991-4319-b39d-d614679b3f4c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736" returned: 0 in 0.460s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e09dc32d-90f8-4204-afa5-d798810f7736" returned: 0 in 0.170s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-e09dc32d-90f8-4204-afa5-d798810f7736" released by "delete_volume" :: held 0.858s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:22:56 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Created reservations ['089b2b44-c057-4443-ba27-affb8c9d26bf'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:22:56 devstack cinder-volume[83206]: WARNING cinder.quota [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1038220246 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1038220246, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:22:56 devstack cinder-volume[83206]: WARNING cinder.quota [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1038220246 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1038220246, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:22:56 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Created reservations ['8e45fc20-2c62-4b80-aeaa-6acb249ea758', '06415e73-556a-468e-a05c-7cda2aa70810', '3461a7ec-4d2e-4e2a-aa34-78737b330dc1', 'b2472747-e795-42a3-9bd1-5485f83bb2f8'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.100s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:57 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:22:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e8325e36-bcb4-46fe-8ab4-be0896a330fb tempest-GroupSnapshotsTest-120634042 None] Delete group completed successfully. Sep 10 13:22:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] group_snapshot 1391cb67-22fd-4bfa-b50b-d387c9b2cab8: deleting Sep 10 13:22:58 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] group_snapshot 1391cb67-22fd-4bfa-b50b-d387c9b2cab8: deleting {{(pid=83206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-906b2398-132f-4f63-93de-8c1c01089e8a" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-906b2398-132f-4f63-93de-8c1c01089e8a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Deleting offline snapshot 906b2398-132f-4f63-93de-8c1c01089e8a of volume 9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] snapshot_file for this snap is: volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e1bf1-7e41-4bf9-ad2b-83439361720a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:58 devstack quobyte-client[83260]: System call of process 86332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a" returned: 0 in 0.598s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:22:59 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa1c0c-c720-47ea-aafa-c6574a18ef88]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:22:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" returned: 0 in 0.477s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a" returned: 0 in 0.223s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:22:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:22:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef.906b2398-132f-4f63-93de-8c1c01089e8a" returned: 0 in 0.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-906b2398-132f-4f63-93de-8c1c01089e8a" released by "_delete_snapshot" :: held 1.844s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" released by "delete_snapshot" :: held 1.893s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:01 devstack cinder-volume[83206]: WARNING cinder.quota [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1038220246 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1038220246, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:23:01 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] Created reservations ['3fc76ec4-6c7d-469a-86ee-27e638f4a27c', '6ca5a051-7f62-4f1b-bd5f-8f39f047f988', '5e4b7806-cd37-40bf-a655-6b393ea7f6bf', '5f9ecad8-27d5-4995-8adb-923530b5b5a8'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:01 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1bd56c0d-7d92-4e64-8e78-b1aa6a0fc5b5 tempest-GroupSnapshotsTest-120634042 None] group_snapshot 1391cb67-22fd-4bfa-b50b-d387c9b2cab8: deleted successfully Sep 10 13:23:03 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" acquired by "delete_volume" :: waited 0.045s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:03 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba88536-5995-4664-ba47-3ac707dc7bda]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:04 devstack quobyte-client[83260]: System call of process 86344 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" returned: 0 in 0.513s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" returned: 0 in 0.140s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9e8684d3-c9e0-4af3-a2e8-07c812bb78ef" released by "delete_volume" :: held 0.888s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Created reservations ['d23b1d2e-bbd5-46e4-b0e2-1508931ce376'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:05 devstack cinder-volume[83206]: WARNING cinder.db.sqlalchemy.api [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1038220246'] Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Created reservations ['c8c57f8a-492f-4b82-a58d-81fbf8feb55d', 'c7620ccc-d972-454b-8238-709173daf364', '7ec74ee5-604a-478d-8ef9-c8dd57154566', 'f50bc1d4-2316-4584-8d0a-c5d6f0bc6c03'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.171s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:05 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:23:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-19b5b3f9-f609-45a7-8aad-d996a2369c7a tempest-GroupSnapshotsTest-120634042 None] Delete group completed successfully. Sep 10 13:23:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-00467228-1053-4102-98b2-38a7b70f2ba3 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-00467228-1053-4102-98b2-38a7b70f2ba3 tempest-GroupSnapshotsTest-120634042 None] Group tempest-GroupSnapshotsTest-Group-929909525: creating Sep 10 13:23:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-00467228-1053-4102-98b2-38a7b70f2ba3 tempest-GroupSnapshotsTest-120634042 None] Group tempest-GroupSnapshotsTest-Group-929909525: created successfully Sep 10 13:23:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-00467228-1053-4102-98b2-38a7b70f2ba3 tempest-GroupSnapshotsTest-120634042 None] Create group completed successfully. Sep 10 13:23:08 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:08 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (94cb5d93-c6b9-4d06-a53b-036b9307af65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7c58c3-5d5d-4681-9c4d-a8b38e6e2284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7c58c3-5d5d-4681-9c4d-a8b38e6e2284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750480309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd10f49-b9d5-4d05-8ee2-4af25f634741,host='devstack@QuobyteHD#QuobyteHD',id=3d20eab2-abca-41fd-bd4b-8a9951a608dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:23:09Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c94d226-3d8b-42ec-a9a0-76d925ef6760),volume_type_id=2c94d226-3d8b-42ec-a9a0-76d925ef6760)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9672f5d-c4e8-49ce-9784-a7de9880a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9672f5d-c4e8-49ce-9784-a7de9880a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bb78d7-a822-4bb2-93c2-782437046311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bb78d7-a822-4bb2-93c2-782437046311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d20eab2-abca-41fd-bd4b-8a9951a608dd', 'volume_name': 'volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9001610-a404-4349-9c94-5130169764f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9001610-a404-4349-9c94-5130169764f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889754ff-5c0e-4dc5-ae21-ed4a944675d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:09 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Volume 3d20eab2-abca-41fd-bd4b-8a9951a608dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd', 'volume_size': 1} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1fd10f49-b9d5-4d05-8ee2-4af25f634741,created_at=2025-09-10T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750480309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd10f49-b9d5-4d05-8ee2-4af25f634741,host='devstack@QuobyteHD#QuobyteHD',id=3d20eab2-abca-41fd-bd4b-8a9951a608dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:23:09Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c94d226-3d8b-42ec-a9a0-76d925ef6760),volume_type_id=2c94d226-3d8b-42ec-a9a0-76d925ef6760)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Creating volume 3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:23:09 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:09 devstack quobyte-client[83260]: System call of process 86350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:09 devstack quobyte-client[83260]: System call of process 86350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:09 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=15, name=volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd 1073741824" returned: 0 in 0.382s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd" returned: 0 in 0.075s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] <== create_volume: return (525ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:23:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.538s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889754ff-5c0e-4dc5-ae21-ed4a944675d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06473df4-96c5-4134-a4bd-86ad4ec64f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:10 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Volume volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd (3d20eab2-abca-41fd-bd4b-8a9951a608dd): created successfully Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06473df4-96c5-4134-a4bd-86ad4ec64f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (94cb5d93-c6b9-4d06-a53b-036b9307af65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.351s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:23:10 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b9dbaaa4-1ab1-45df-a477-890be99b6551 tempest-GroupSnapshotsTest-120634042 None] Created volume successfully. Sep 10 13:23:11 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:11 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (13965107-3e1e-489a-95a9-4bdf6d70938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c717de1f-47d6-4640-9bf0-2030e4ad5a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c717de1f-47d6-4640-9bf0-2030e4ad5a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775621165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd10f49-b9d5-4d05-8ee2-4af25f634741,host='devstack@QuobyteHD#QuobyteHD',id=79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:23:12Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c94d226-3d8b-42ec-a9a0-76d925ef6760),volume_type_id=2c94d226-3d8b-42ec-a9a0-76d925ef6760)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68319a39-21fc-4194-ae23-23243312b560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68319a39-21fc-4194-ae23-23243312b560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303197b7-690f-43e4-9c4a-39d25c0bb8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303197b7-690f-43e4-9c4a-39d25c0bb8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a', 'volume_name': 'volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9f0c97-220f-4904-8d69-ff5ce35b5eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9f0c97-220f-4904-8d69-ff5ce35b5eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eda4ce-095f-4fb1-b225-5c397bd9e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:12 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Volume 79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a', 'volume_size': 1} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1fd10f49-b9d5-4d05-8ee2-4af25f634741,created_at=2025-09-10T11:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775621165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd10f49-b9d5-4d05-8ee2-4af25f634741,host='devstack@QuobyteHD#QuobyteHD',id=79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:23:12Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c94d226-3d8b-42ec-a9a0-76d925ef6760),volume_type_id=2c94d226-3d8b-42ec-a9a0-76d925ef6760)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Creating volume 79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:23:12 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:12 devstack quobyte-client[83260]: System call of process 86365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:12 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=16, name=volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a 1073741824" returned: 0 in 0.541s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" returned: 0 in 0.279s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] <== create_volume: return (933ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eda4ce-095f-4fb1-b225-5c397bd9e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b8cba-098c-4536-aa15-bb18650eec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:13 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Volume volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a (79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a): created successfully Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b8cba-098c-4536-aa15-bb18650eec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (13965107-3e1e-489a-95a9-4bdf6d70938c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b31e33e-4939-4320-9601-e7265f3f8ac7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:13 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-15b87d34-4866-4e00-99a1-02448ca3c478 tempest-GroupSnapshotsTest-120634042 None] Created volume successfully. Sep 10 13:23:14 devstack quobyte-client[83260]: System call of process 86375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca" returned: 0 in 0.624s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.684s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2f4fe590-1c51-448c-98e9-f68b3421c89e tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b183f64-395a-4768-961b-518ef8ca26f6', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:23:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2f4fe590-1c51-448c-98e9-f68b3421c89e tempest-GroupSnapshotsTest-120634042 None] Update group completed successfully. Sep 10 13:23:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-344b6de7-31e3-48f5-a70a-4efece70659b req-7f0d9872-0e09-48d6-b4d9-4138a46b4cb2 tempest-AttachVolumeShelveTestJSON-1870643907 None] attachment_update completed successfully. Sep 10 13:23:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-013a71ca-58f5-4d41-a14c-53b69bdeb4ea tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-013a71ca-58f5-4d41-a14c-53b69bdeb4ea tempest-GroupSnapshotsTest-120634042 None] Update group completed successfully. Sep 10 13:23:17 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5e539a7d-18af-4064-b941-636b3b286f5e tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:17 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5e539a7d-18af-4064-b941-636b3b286f5e tempest-GroupSnapshotsTest-120634042 None] Update group completed successfully. Sep 10 13:23:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-82d496dc-95f4-4f63-befd-2cb63fc05af8 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:18 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-82d496dc-95f4-4f63-befd-2cb63fc05af8 tempest-GroupSnapshotsTest-120634042 None] Update group completed successfully. Sep 10 13:23:20 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] GroupSnapshot b5e7138e-f3c6-47b2-85c2-5502bb13a2cf: creating. Sep 10 13:23:20 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Group snapshot b5e7138e-f3c6-47b2-85c2-5502bb13a2cf: creating. {{(pid=83206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 13:23:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Creating offline snapshot 51dba6d3-d15e-420f-b126-03e06fdad393 of volume 79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:23:20 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec3ac2-7e0a-4248-89ad-25880be9c13e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:21 devstack quobyte-client[83260]: System call of process 86436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" returned: 0 in 0.699s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:21 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=17, name=volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 1G" returned: 0 in 0.419s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img rebase -u -b volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:22 devstack quobyte-client[83260]: System call of process 86446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img rebase -u -b volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393" returned: 0 in 0.304s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393" returned: 0 in 0.132s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393" returned: 0 in 0.080s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.info" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:23:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.info" returned: 0 in 0.187s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Creating offline snapshot c7a635d6-4ca4-43fd-9779-78afa039560c of volume 3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:23:23 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca08401-bdec-4612-b4bb-2bd1c3281004]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:23 devstack quobyte-client[83260]: System call of process 86455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd" returned: 0 in 0.543s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:24 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=19, name=volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c 1G" returned: 0 in 0.445s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img rebase -u -b volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c" returned: 0 in 0.183s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c" returned: 0 in 0.107s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.info" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:23:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.info" returned: 0 in 0.095s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:25 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4558f7f9-a9a7-4746-8b10-1d9b908fe170 tempest-GroupSnapshotsTest-120634042 None] group_snapshot b5e7138e-f3c6-47b2-85c2-5502bb13a2cf: created successfully Sep 10 13:23:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] group_snapshot b5e7138e-f3c6-47b2-85c2-5502bb13a2cf: deleting Sep 10 13:23:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] group_snapshot b5e7138e-f3c6-47b2-85c2-5502bb13a2cf: deleting {{(pid=83206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" acquired by "delete_snapshot" :: waited 0.123s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-51dba6d3-d15e-420f-b126-03e06fdad393" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-51dba6d3-d15e-420f-b126-03e06fdad393" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Deleting offline snapshot 51dba6d3-d15e-420f-b126-03e06fdad393 of volume 79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] snapshot_file for this snap is: volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba90107e-fe0f-4d6f-970c-9104b744e837]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:28 devstack quobyte-client[83260]: System call of process 86477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393" returned: 0 in 0.623s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:28 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:23:28 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220a277-4348-4e10-96a0-8f29033a6046]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" returned: 0 in 1.052s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:29 devstack quobyte-client[83260]: System call of process 86494 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393" returned: 0 in 0.327s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a.51dba6d3-d15e-420f-b126-03e06fdad393" returned: 0 in 0.138s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-51dba6d3-d15e-420f-b126-03e06fdad393" released by "_delete_snapshot" :: held 2.647s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" released by "delete_snapshot" :: held 2.838s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-3d20eab2-abca-41fd-bd4b-8a9951a608dd" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-3d20eab2-abca-41fd-bd4b-8a9951a608dd" acquired by "delete_snapshot" :: waited 0.056s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-c7a635d6-4ca4-43fd-9779-78afa039560c" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-c7a635d6-4ca4-43fd-9779-78afa039560c" acquired by "_delete_snapshot" :: waited 0.083s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Deleting offline snapshot c7a635d6-4ca4-43fd-9779-78afa039560c of volume 3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:23:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] snapshot_file for this snap is: volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:23:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3f87d-ac64-4f3a-a206-9fc1107cfbe8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c" returned: 0 in 1.500s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:23:32 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15954066-c507-40ed-b784-fab7f50caa73]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd" returned: 0 in 1.198s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:34 devstack quobyte-client[83260]: System call of process 86567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c" returned: 0 in 0.641s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd.c7a635d6-4ca4-43fd-9779-78afa039560c" returned: 0 in 0.158s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-c7a635d6-4ca4-43fd-9779-78afa039560c" released by "_delete_snapshot" :: held 4.279s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-3d20eab2-abca-41fd-bd4b-8a9951a608dd" released by "delete_snapshot" :: held 4.387s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:36 devstack cinder-volume[83206]: WARNING cinder.quota [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-957647273 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-957647273, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:23:36 devstack cinder-volume[83206]: WARNING cinder.quota [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-957647273 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-957647273, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:23:36 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Created reservations ['fe0297b4-45a2-4695-ba9c-e56bb4de9969', '7670c62c-39a8-4db2-bded-e7544a32a67e', 'd9ae3587-2476-4152-a493-3880ebb71005', 'a0f318ee-65fe-42fe-afba-af0c46592065'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:36 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] Created reservations ['9a77add9-8723-4a12-8316-d48ee6b4a62f', '623e02cb-74e5-4efb-8f85-f1fc5dd3cb88', 'b34e03b7-6f48-4511-a7ca-3b976bceef4c', 'a10af3d0-28d0-4bfb-b7e8-a724f04bddbd'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4be81ff8-2903-44db-abb8-118567e0ee7e tempest-GroupSnapshotsTest-120634042 None] group_snapshot b5e7138e-f3c6-47b2-85c2-5502bb13a2cf: deleted successfully Sep 10 13:23:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-3d20eab2-abca-41fd-bd4b-8a9951a608dd" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-3d20eab2-abca-41fd-bd4b-8a9951a608dd" acquired by "delete_volume" :: waited 0.041s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:38 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0d3b40-22c9-4b73-97ec-2aa97e2d8af8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd" returned: 0 in 0.593s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3d20eab2-abca-41fd-bd4b-8a9951a608dd" returned: 0 in 0.438s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-3d20eab2-abca-41fd-bd4b-8a9951a608dd" released by "delete_volume" :: held 1.429s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" acquired by "delete_volume" :: waited 0.034s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b75b771-ea0d-49e3-abf3-c178df9d73f7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" returned: 0 in 1.208s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" returned: 0 in 0.309s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-79c2a5ea-f4e2-44e7-8601-7ddd2e73f18a" released by "delete_volume" :: held 1.866s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:42 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Created reservations ['1dca568f-3d31-4fcd-a268-d691212d0a9f'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:42 devstack cinder-volume[83206]: WARNING cinder.quota [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-957647273 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-957647273, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:23:42 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Created reservations ['1099d568-812d-4bb9-800b-a5b7ac02cee3', 'fddad164-e102-4ae6-b8f1-a2fb4b087d10', '538d1e8a-e4aa-48d7-81cd-7e1cc3392ef4', '6600b452-2904-4812-bfa6-17dd8edf98e7'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Created reservations ['63255593-7ab1-4063-9441-84c3ff99883e', 'dd10b10a-b89d-4e19-bc18-e17cab640fc2', 'b5540b54-dcc0-4738-a2e8-ed49e8f79df2', '08b0ac53-36f0-494f-a04b-5f3ba5bdb3ff'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.459s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:44 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:23:44 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c5541739-21dc-403a-a99d-60d78d776ae4 tempest-GroupSnapshotsTest-120634042 None] Delete group completed successfully. Sep 10 13:23:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-e4770a07-011a-4d0f-9d4a-775487a5f232 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e4770a07-011a-4d0f-9d4a-775487a5f232 tempest-GroupSnapshotsTest-120634042 None] Group tempest-GroupSnapshotsTest-Group-1846486782: creating Sep 10 13:23:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e4770a07-011a-4d0f-9d4a-775487a5f232 tempest-GroupSnapshotsTest-120634042 None] Group tempest-GroupSnapshotsTest-Group-1846486782: created successfully Sep 10 13:23:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e4770a07-011a-4d0f-9d4a-775487a5f232 tempest-GroupSnapshotsTest-120634042 None] Create group completed successfully. Sep 10 13:23:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (7e13bbf2-10eb-4bc1-a8e6-e64c401e096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f378a4a0-c193-45af-b9c7-3036710d0088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f378a4a0-c193-45af-b9c7-3036710d0088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2143892756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e13e7aa0-4721-403b-9104-7479ad537835,host='devstack@QuobyteHD#QuobyteHD',id=9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:23:48Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ace262b-fb19-4d96-8888-3c494cba3fd7),volume_type_id=4ace262b-fb19-4d96-8888-3c494cba3fd7)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f2fa90-03df-4a09-869a-df0ee89ae3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f2fa90-03df-4a09-869a-df0ee89ae3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f247474-77ec-4c72-8c3a-7ac3fc072cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f247474-77ec-4c72-8c3a-7ac3fc072cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60', 'volume_name': 'volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae1c8c-23e4-4f88-a97a-a814cf468e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae1c8c-23e4-4f88-a97a-a814cf468e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999c61ca-49e3-489c-a9ca-75eeb54613e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:47 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Volume 9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60', 'volume_size': 1} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e13e7aa0-4721-403b-9104-7479ad537835,created_at=2025-09-10T11:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2143892756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e13e7aa0-4721-403b-9104-7479ad537835,host='devstack@QuobyteHD#QuobyteHD',id=9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4c021c4bfd4570b95b6c40df87b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:23:48Z,use_quota=True,user_id='f930a4803b354354a2acd0b24f502dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ace262b-fb19-4d96-8888-3c494cba3fd7),volume_type_id=4ace262b-fb19-4d96-8888-3c494cba3fd7)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Creating volume 9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:23:47 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:23:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:48 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=21, name=volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:23:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 1073741824" returned: 0 in 0.405s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" returned: 0 in 0.109s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:23:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999c61ca-49e3-489c-a9ca-75eeb54613e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3a581c-1f11-4e49-8c6f-fdee52a0fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:23:49 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=65,cinder:SELECT=80,cinder:INSERT=24,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:23:49 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Volume volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 (9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60): created successfully Sep 10 13:23:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3a581c-1f11-4e49-8c6f-fdee52a0fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:23:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Flow 'volume_create_manager' (7e13bbf2-10eb-4bc1-a8e6-e64c401e096f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:23:49 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=86,cinder:SELECT=78,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:23:49 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3af1bce5-4c24-43b0-b97d-d799bf974b83 tempest-GroupSnapshotsTest-120634042 None] Created volume successfully. Sep 10 13:23:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] GroupSnapshot 87697bee-5da9-44cd-9794-ff2899c0275a: creating. Sep 10 13:23:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Group snapshot 87697bee-5da9-44cd-9794-ff2899c0275a: creating. {{(pid=83206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Creating offline snapshot a573fbf7-94a2-4fc8-9601-5466b9d9d870 of volume 9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e6677-4bc6-4c79-beee-d5c92db3bf65]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:51 devstack quobyte-client[83260]: System call of process 86624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" returned: 0 in 0.589s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:51 devstack quobyte-client[83260]: System call of process 86627 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:52 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=22, name=volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 1G" returned: 0 in 0.574s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img rebase -u -b volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870" returned: 0 in 0.222s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870" returned: 0 in 0.124s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870" returned: 0 in 0.084s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.info" returned: 0 in 0.123s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:23:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.info" returned: 0 in 0.084s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:23:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b39a00e5-1290-4941-8d7f-dd96c3b86a4a tempest-GroupSnapshotsTest-120634042 None] group_snapshot 87697bee-5da9-44cd-9794-ff2899c0275a: created successfully Sep 10 13:23:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] group_snapshot 87697bee-5da9-44cd-9794-ff2899c0275a: deleting Sep 10 13:23:54 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:23:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] group_snapshot 87697bee-5da9-44cd-9794-ff2899c0275a: deleting {{(pid=83206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 13:23:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" acquired by "delete_snapshot" :: waited 0.129s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-a573fbf7-94a2-4fc8-9601-5466b9d9d870" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:23:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-a573fbf7-94a2-4fc8-9601-5466b9d9d870" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:23:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Deleting offline snapshot a573fbf7-94a2-4fc8-9601-5466b9d9d870 of volume 9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:23:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] snapshot_file for this snap is: volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:23:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb6a7f-03be-45e1-9925-7073fd5415e1]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:56 devstack quobyte-client[83260]: System call of process 86706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:23:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870" returned: 0 in 1.100s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:23:56 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad32bc0-63b1-4caa-926f-f9a97542444a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:23:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" returned: 0 in 1.130s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870" returned: 0 in 0.344s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:23:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60.a573fbf7-94a2-4fc8-9601-5466b9d9d870" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:23:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-a573fbf7-94a2-4fc8-9601-5466b9d9d870" released by "_delete_snapshot" :: held 3.236s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" released by "delete_snapshot" :: held 3.290s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:23:58 devstack cinder-volume[83206]: WARNING cinder.quota [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-747211095 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-747211095, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:23:58 devstack cinder-volume[83206]: WARNING cinder.quota [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-747211095 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-747211095, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:23:59 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] Created reservations ['dbb20a5b-8ddf-40cf-87d6-ca0c03d16403', 'e90ba6a3-1852-4606-98f2-0e0c66aedf11', '8e61a0a8-0f77-47a2-a616-50ca6659dacd', 'eb5237ae-2a4f-4a0a-9cc9-015b20cd537e'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:23:59 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3c2976d5-28bc-4eea-95c3-554ea14340ad tempest-GroupSnapshotsTest-120634042 None] group_snapshot 87697bee-5da9-44cd-9794-ff2899c0275a: deleted successfully Sep 10 13:24:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "cinder-quobyte-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:24:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" acquired by "delete_volume" :: waited 0.020s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:24:01 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d9ced-8b5a-4468-ad25-69b7c7e042b6]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:24:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:01 devstack quobyte-client[83260]: System call of process 87050 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:24:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" returned: 0 in 0.773s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" returned: 0 in 0.103s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Lock "cinder-quobyte-9fdfcabc-62c8-4d2e-8c09-0dff2fd1aa60" released by "delete_volume" :: held 1.230s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:24:03 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Created reservations ['9a3bfa25-306e-42ec-8b01-8d1cfe31e7a2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:04 devstack cinder-volume[83206]: WARNING cinder.quota [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-747211095 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-747211095, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:24:04 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Created reservations ['7e024d12-7bee-4f5a-94af-59901e491a03', '001bf7f6-70fd-4112-993b-0b5a71ad8c96', '8cb16ce6-ed87-4750-bb58-17013e6b3aad', '96da730e-b8f2-47d8-89ca-6c8f76e5e97d'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.078s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.463s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:05 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:24:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b4bf5ec4-2813-4729-b00e-1fa56ed0d2ee tempest-GroupSnapshotsTest-120634042 None] Delete group completed successfully. Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.292s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:24:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=23,cinder:UPDATE=13,cinder:INSERT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:24:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:DELETE=1,cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:24:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b95be843-455f-458c-be9e-c18b28b2ef9f tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b95be843-455f-458c-be9e-c18b28b2ef9f tempest-GroupsTest-1762598620 None] Group tempest-Group1-1378348294: creating Sep 10 13:24:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b95be843-455f-458c-be9e-c18b28b2ef9f tempest-GroupsTest-1762598620 None] Group tempest-Group1-1378348294: created successfully Sep 10 13:24:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b95be843-455f-458c-be9e-c18b28b2ef9f tempest-GroupsTest-1762598620 None] Create group completed successfully. Sep 10 13:24:29 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-77b68774-4cfb-4976-8307-cde346790130 tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-77b68774-4cfb-4976-8307-cde346790130 tempest-GroupsTest-1762598620 None] Group tempest-Group2-220731744: creating Sep 10 13:24:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-77b68774-4cfb-4976-8307-cde346790130 tempest-GroupsTest-1762598620 None] Group tempest-Group2-220731744: created successfully Sep 10 13:24:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-77b68774-4cfb-4976-8307-cde346790130 tempest-GroupsTest-1762598620 None] Create group completed successfully. Sep 10 13:24:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Flow 'volume_create_manager' (26c32650-9a26-4cab-a9b7-5750eec105a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4440aa3-7818-4784-a720-1a989947079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4440aa3-7818-4784-a720-1a989947079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129047032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0654a6b7-e990-4c98-a50a-75da97e72004,host='devstack@QuobyteHD#QuobyteHD',id=afcb8233-676a-4284-bba3-4b6c8b83d1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43dcc948a544cb48413ad50281099c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:31Z,use_quota=True,user_id='5a164a7f7a3e461389b29a1f70d2f9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(242bae50-c042-411b-9db0-7953bf472696),volume_type_id=242bae50-c042-411b-9db0-7953bf472696)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc7c21d-3bc9-4d22-8b5d-1b330bd779f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc7c21d-3bc9-4d22-8b5d-1b330bd779f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aadae7a-711d-46f0-88d5-5ef5229e5d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aadae7a-711d-46f0-88d5-5ef5229e5d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcb8233-676a-4284-bba3-4b6c8b83d1ad', 'volume_name': 'volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4c130d-75f3-4e70-a97f-37982f031a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4c130d-75f3-4e70-a97f-37982f031a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d15ffe-cc4a-4b0b-9c76-57f941a949c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:31 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Volume afcb8233-676a-4284-bba3-4b6c8b83d1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad', 'volume_size': 1} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0654a6b7-e990-4c98-a50a-75da97e72004,created_at=2025-09-10T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129047032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0654a6b7-e990-4c98-a50a-75da97e72004,host='devstack@QuobyteHD#QuobyteHD',id=afcb8233-676a-4284-bba3-4b6c8b83d1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43dcc948a544cb48413ad50281099c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:31Z,use_quota=True,user_id='5a164a7f7a3e461389b29a1f70d2f9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(242bae50-c042-411b-9db0-7953bf472696),volume_type_id=242bae50-c042-411b-9db0-7953bf472696)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Creating volume afcb8233-676a-4284-bba3-4b6c8b83d1ad {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:24:31 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:31 devstack quobyte-client[83260]: System call of process 87222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:24:31 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=24, name=volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad 1073741824" returned: 0 in 0.333s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad" returned: 0 in 0.083s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] <== create_volume: return (488ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:24:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.501s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d15ffe-cc4a-4b0b-9c76-57f941a949c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bba23a-1d69-4e90-a4b6-49630fa1ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:32 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Volume volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad (afcb8233-676a-4284-bba3-4b6c8b83d1ad): created successfully Sep 10 13:24:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bba23a-1d69-4e90-a4b6-49630fa1ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Flow 'volume_create_manager' (26c32650-9a26-4cab-a9b7-5750eec105a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5d602880-8a32-46bd-a5b5-42dc361ef4fb tempest-GroupsTest-1762598620 None] Created volume successfully. Sep 10 13:24:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Acquiring lock "cinder-quobyte-afcb8233-676a-4284-bba3-4b6c8b83d1ad" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Lock "cinder-quobyte-afcb8233-676a-4284-bba3-4b6c8b83d1ad" acquired by "delete_volume" :: waited 0.047s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede4fd6a-d0fb-4a67-aa4c-999a976397c8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad" returned: 0 in 0.494s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-afcb8233-676a-4284-bba3-4b6c8b83d1ad" returned: 0 in 0.089s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Lock "cinder-quobyte-afcb8233-676a-4284-bba3-4b6c8b83d1ad" released by "delete_volume" :: held 0.748s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Created reservations ['5d7f2e92-4fbe-4a23-a23a-129ad3f73d17'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:34 devstack cinder-volume[83206]: WARNING cinder.quota [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-321073061 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-321073061, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:24:34 devstack cinder-volume[83206]: WARNING cinder.quota [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-321073061 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-321073061, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Created reservations ['29b821fc-47a0-43d9-890a-f342ecb921e3', '86347459-42ca-4bd6-918d-e22648d5e5ad', '224929b5-8f32-4991-8086-a52bbf1d895f', '121af935-b734-479a-83c2-5919b250b800'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.099s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:34 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:24:34 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0625ebc1-ec79-4012-8e49-79d2211ab505 tempest-GroupsTest-1762598620 None] Delete group completed successfully. Sep 10 13:24:35 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Created reservations ['a8b3de82-61ab-462f-9f3c-a1eab8273ae3'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.095s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:35 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:24:35 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-6e6df5c0-fb65-48f6-8c74-4ea55ae97aad tempest-GroupsTest-1762598620 None] Delete group completed successfully. Sep 10 13:24:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-178bda51-833c-4ee2-93e6-4966fcf9f9f1 tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-178bda51-833c-4ee2-93e6-4966fcf9f9f1 tempest-GroupsTest-1762598620 None] Group tempest-GroupsTest-Group-1265329956: creating Sep 10 13:24:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-178bda51-833c-4ee2-93e6-4966fcf9f9f1 tempest-GroupsTest-1762598620 None] Group tempest-GroupsTest-Group-1265329956: created successfully Sep 10 13:24:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-178bda51-833c-4ee2-93e6-4966fcf9f9f1 tempest-GroupsTest-1762598620 None] Create group completed successfully. Sep 10 13:24:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:38 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Flow 'volume_create_manager' (103545d0-6c13-43f0-9e01-712223836ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5522a4e-1501-446d-8fd1-058cdb682ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5522a4e-1501-446d-8fd1-058cdb682ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142381118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6da8cc0c-df0b-4878-ba3c-adee95196789,host='devstack@QuobyteHD#QuobyteHD',id=3e2375ba-241b-4c33-9b98-af4c70993c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43dcc948a544cb48413ad50281099c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:39Z,use_quota=True,user_id='5a164a7f7a3e461389b29a1f70d2f9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca72f52-fed6-4a45-b183-6765df129a1c),volume_type_id=8ca72f52-fed6-4a45-b183-6765df129a1c)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b905f885-aa2c-459e-ab8f-ac0ada3022d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b905f885-aa2c-459e-ab8f-ac0ada3022d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89122096-3983-4bda-badd-e48e72641bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89122096-3983-4bda-badd-e48e72641bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2375ba-241b-4c33-9b98-af4c70993c94', 'volume_name': 'volume-3e2375ba-241b-4c33-9b98-af4c70993c94', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8c2614-906a-4a6d-8b47-14ae9bffe7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8c2614-906a-4a6d-8b47-14ae9bffe7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1052321b-e777-496d-91a7-141836549ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:39 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Volume 3e2375ba-241b-4c33-9b98-af4c70993c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2375ba-241b-4c33-9b98-af4c70993c94', 'volume_size': 1} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6da8cc0c-df0b-4878-ba3c-adee95196789,created_at=2025-09-10T11:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142381118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6da8cc0c-df0b-4878-ba3c-adee95196789,host='devstack@QuobyteHD#QuobyteHD',id=3e2375ba-241b-4c33-9b98-af4c70993c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43dcc948a544cb48413ad50281099c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:39Z,use_quota=True,user_id='5a164a7f7a3e461389b29a1f70d2f9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca72f52-fed6-4a45-b183-6765df129a1c),volume_type_id=8ca72f52-fed6-4a45-b183-6765df129a1c)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Creating volume 3e2375ba-241b-4c33-9b98-af4c70993c94 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:24:39 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:39 devstack quobyte-client[83260]: System call of process 87236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:24:39 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=25, name=volume-3e2375ba-241b-4c33-9b98-af4c70993c94, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94 1073741824" returned: 0 in 0.455s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94" returned: 0 in 0.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] <== create_volume: return (673ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:24:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1052321b-e777-496d-91a7-141836549ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2375ba-241b-4c33-9b98-af4c70993c94', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfb104b-1c49-473e-b9b4-ff68bf092120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:40 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Volume volume-3e2375ba-241b-4c33-9b98-af4c70993c94 (3e2375ba-241b-4c33-9b98-af4c70993c94): created successfully Sep 10 13:24:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfb104b-1c49-473e-b9b4-ff68bf092120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Flow 'volume_create_manager' (103545d0-6c13-43f0-9e01-712223836ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:40 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-68e93292-acf3-48b1-8f36-1d7567b233c0 tempest-GroupsTest-1762598620 None] Created volume successfully. Sep 10 13:24:41 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:41 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:24:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Flow 'volume_create_manager' (0ab7ce33-f940-43c9-9293-01f946d85f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8e3fb3-8b2e-45ba-9c70-de18654eb26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8e3fb3-8b2e-45ba-9c70-de18654eb26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418957738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6da8cc0c-df0b-4878-ba3c-adee95196789,host='devstack@QuobyteHD#QuobyteHD',id=151afa47-a995-4a62-9d01-f5734f8c3bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43dcc948a544cb48413ad50281099c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:42Z,use_quota=True,user_id='5a164a7f7a3e461389b29a1f70d2f9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca72f52-fed6-4a45-b183-6765df129a1c),volume_type_id=8ca72f52-fed6-4a45-b183-6765df129a1c)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a868de-cf2a-459b-8dcf-069207df535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a868de-cf2a-459b-8dcf-069207df535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7084fd-162d-42ba-82a6-8e9e235227c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7084fd-162d-42ba-82a6-8e9e235227c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151afa47-a995-4a62-9d01-f5734f8c3bae', 'volume_name': 'volume-151afa47-a995-4a62-9d01-f5734f8c3bae', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8325847b-23c8-430d-b03f-3514d81d497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8325847b-23c8-430d-b03f-3514d81d497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc8cbb-b74a-4663-b9d6-8c2390a54bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:42 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Volume 151afa47-a995-4a62-9d01-f5734f8c3bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151afa47-a995-4a62-9d01-f5734f8c3bae', 'volume_size': 1} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6da8cc0c-df0b-4878-ba3c-adee95196789,created_at=2025-09-10T11:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418957738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6da8cc0c-df0b-4878-ba3c-adee95196789,host='devstack@QuobyteHD#QuobyteHD',id=151afa47-a995-4a62-9d01-f5734f8c3bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43dcc948a544cb48413ad50281099c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:42Z,use_quota=True,user_id='5a164a7f7a3e461389b29a1f70d2f9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca72f52-fed6-4a45-b183-6765df129a1c),volume_type_id=8ca72f52-fed6-4a45-b183-6765df129a1c)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Creating volume 151afa47-a995-4a62-9d01-f5734f8c3bae {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:24:42 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:42 devstack quobyte-client[83260]: System call of process 87241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:24:42 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=26, name=volume-151afa47-a995-4a62-9d01-f5734f8c3bae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae 1073741824" returned: 0 in 0.414s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc8cbb-b74a-4663-b9d6-8c2390a54bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151afa47-a995-4a62-9d01-f5734f8c3bae', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73597730-bb4d-4b80-a8cc-a737f6cdd221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:43 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Volume volume-151afa47-a995-4a62-9d01-f5734f8c3bae (151afa47-a995-4a62-9d01-f5734f8c3bae): created successfully Sep 10 13:24:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73597730-bb4d-4b80-a8cc-a737f6cdd221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Flow 'volume_create_manager' (0ab7ce33-f940-43c9-9293-01f946d85f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:43 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2a68f2f1-168d-4823-9f6e-ea19219ad2d5 tempest-GroupsTest-1762598620 None] Created volume successfully. Sep 10 13:24:44 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-45055a94-227e-4acb-8f12-9da58cf8172b tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:44 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-45055a94-227e-4acb-8f12-9da58cf8172b tempest-GroupsTest-1762598620 None] Update group completed successfully. Sep 10 13:24:45 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-86755de9-87a9-4b11-a9d8-c9904a4ebc74 tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:45 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-86755de9-87a9-4b11-a9d8-c9904a4ebc74 tempest-GroupsTest-1762598620 None] Update group completed successfully. Sep 10 13:24:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Acquiring lock "cinder-quobyte-151afa47-a995-4a62-9d01-f5734f8c3bae" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:24:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Lock "cinder-quobyte-151afa47-a995-4a62-9d01-f5734f8c3bae" acquired by "delete_volume" :: waited 0.117s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:24:47 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d99a7d-7756-42dd-a5c2-3e6fc3ec890b]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:24:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae" returned: 0 in 0.668s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-151afa47-a995-4a62-9d01-f5734f8c3bae" returned: 0 in 0.151s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Lock "cinder-quobyte-151afa47-a995-4a62-9d01-f5734f8c3bae" released by "delete_volume" :: held 1.099s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:24:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Acquiring lock "cinder-quobyte-3e2375ba-241b-4c33-9b98-af4c70993c94" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:24:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Lock "cinder-quobyte-3e2375ba-241b-4c33-9b98-af4c70993c94" acquired by "delete_volume" :: waited 0.204s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:24:49 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b99c28-7cbe-4c9b-b2a2-1e58240c7d8d]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:24:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:49 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:24:49 devstack quobyte-client[83260]: System call of process 87281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:24:49 devstack quobyte-client[83260]: System call of process 87281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:24:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Flow 'volume_create_manager' (d83232a6-c0b3-4d24-9e39-ec4462486ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad21c88-47e3-4877-b654-7915a8df1170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad21c88-47e3-4877-b654-7915a8df1170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-451118593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31cc429e-9102-4b34-bb74-b59aa8980832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464336396606451cb69878ad97ac0d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:49Z,use_quota=True,user_id='4fc41337a12a42cb8045697561d66658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f913e1-81e1-43cd-b6b4-1d52bbb98adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f913e1-81e1-43cd-b6b4-1d52bbb98adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2f9ea5-9676-4d8d-900f-5979ddab8ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2f9ea5-9676-4d8d-900f-5979ddab8ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31cc429e-9102-4b34-bb74-b59aa8980832', 'volume_name': 'volume-31cc429e-9102-4b34-bb74-b59aa8980832', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b94b94-9ecd-448d-b9b8-6721fd5ff272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b94b94-9ecd-448d-b9b8-6721fd5ff272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a3d2d3-ef68-4ea0-b7f2-8fd18cfd52c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:50 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume 31cc429e-9102-4b34-bb74-b59aa8980832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31cc429e-9102-4b34-bb74-b59aa8980832', 'volume_size': 1} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-451118593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31cc429e-9102-4b34-bb74-b59aa8980832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464336396606451cb69878ad97ac0d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:24:49Z,use_quota=True,user_id='4fc41337a12a42cb8045697561d66658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Creating volume 31cc429e-9102-4b34-bb74-b59aa8980832 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:24:50 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94" returned: 0 in 1.123s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:50 devstack quobyte-client[83260]: System call of process 87286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:24:50 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=27, name=volume-31cc429e-9102-4b34-bb74-b59aa8980832, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3e2375ba-241b-4c33-9b98-af4c70993c94" returned: 0 in 0.218s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Lock "cinder-quobyte-3e2375ba-241b-4c33-9b98-af4c70993c94" released by "delete_volume" :: held 1.673s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832 1073741824" returned: 0 in 0.798s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832" returned: 0 in 0.305s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] <== create_volume: return (1208ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a3d2d3-ef68-4ea0-b7f2-8fd18cfd52c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31cc429e-9102-4b34-bb74-b59aa8980832', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf26f40-89dd-43c4-9de4-223cd4b1be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:24:51 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume volume-31cc429e-9102-4b34-bb74-b59aa8980832 (31cc429e-9102-4b34-bb74-b59aa8980832): created successfully Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf26f40-89dd-43c4-9de4-223cd4b1be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Flow 'volume_create_manager' (d83232a6-c0b3-4d24-9e39-ec4462486ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:24:51 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-073c0a49-01d8-468d-a6c3-6839f727525f tempest-AttachSCSIVolumeTestJSON-158970712 None] Created volume successfully. Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Created reservations ['dc10136f-62ae-4afa-ac83-5aef1286eb5f'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:51 devstack cinder-volume[83206]: WARNING cinder.quota [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-267895973 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-267895973, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:24:51 devstack cinder-volume[83206]: WARNING cinder.quota [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-267895973 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-267895973, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Created reservations ['40b2b331-66ef-46f6-a243-eeb1d32101d5', 'aa8058a4-a731-481f-8deb-058f90dc893f', 'ef8b37c6-d547-4663-b7ba-5ab4c3252168', '318b40a5-244d-4ad2-bab5-09d60cc4773a'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:51 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Created reservations ['3dc796a4-3a2b-4d61-a0ee-0cd804c02d05', '6de5ab0d-1107-499b-98f5-aa484da8331b', 'a3ee9d2e-2c85-4b0e-b7b3-4d3a2c014ace', 'ba40c462-9964-40e9-87e7-12e51817b43b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.114s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:52 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:24:52 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3533b7eb-9b87-4a1b-8e25-23d730d9025d tempest-GroupsTest-1762598620 None] Delete group completed successfully. Sep 10 13:24:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:24:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:24:56 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dbefc3-f20b-4afc-8462-fe137fe6eb93]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:24:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:24:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832" returned: 0 in 0.463s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:24:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.531s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:24:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-31cc429e-9102-4b34-bb74-b59aa8980832', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f0c2838-35f8-4db6-9bb3-35a7a5f187fc', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:24:57 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-0c6fb6e0-6552-4ebe-a655-8759942993c3 req-e1cd0e23-5876-4dc3-bc61-9de4108363ae tempest-AttachSCSIVolumeTestJSON-158970712 None] attachment_update completed successfully. Sep 10 13:24:58 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b30b7ba9-95f1-45dc-b413-39e3d0973347 tempest-GroupsV320Test-347501157 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:58 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b30b7ba9-95f1-45dc-b413-39e3d0973347 tempest-GroupsV320Test-347501157 None] Group tempest-GroupsV320Test-Group-1009488374: creating Sep 10 13:24:58 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b30b7ba9-95f1-45dc-b413-39e3d0973347 tempest-GroupsV320Test-347501157 None] Group tempest-GroupsV320Test-Group-1009488374: created successfully Sep 10 13:24:58 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b30b7ba9-95f1-45dc-b413-39e3d0973347 tempest-GroupsV320Test-347501157 None] Create group completed successfully. Sep 10 13:24:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:24:59 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Created reservations ['405cd4cb-d597-4f44-aa5f-08bd3cde610b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.090s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:00 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:25:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7175d60c-6c46-4f0d-8621-ffa40d1e2a0a tempest-GroupsV320Test-347501157 None] Delete group completed successfully. Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=51,cinder:UPDATE=58,cinder:INSERT=11,cinder:DELETE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=55,cinder:UPDATE=41,cinder:DELETE=1,cinder:INSERT=5 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.196s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:25:28 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-8ac0d774-13aa-4a66-800a-618ce302c1ee req-436d50b3-da7b-4bf7-97ed-f710b31ebd8b tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:25:28 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-8ac0d774-13aa-4a66-800a-618ce302c1ee req-436d50b3-da7b-4bf7-97ed-f710b31ebd8b tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:25:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-8ac0d774-13aa-4a66-800a-618ce302c1ee req-436d50b3-da7b-4bf7-97ed-f710b31ebd8b tempest-AttachSCSIVolumeTestJSON-158970712 None] Terminate volume connection completed successfully. Sep 10 13:25:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-8ac0d774-13aa-4a66-800a-618ce302c1ee req-436d50b3-da7b-4bf7-97ed-f710b31ebd8b tempest-AttachSCSIVolumeTestJSON-158970712 None] Deleting attachment 8f0c2838-35f8-4db6-9bb3-35a7a5f187fc. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:25:35 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Flow 'volume_create_manager' (38275308-a355-4797-8469-c7e8f8985af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a7affe-da47-4822-abe4-1b5dcdf4d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a7affe-da47-4822-abe4-1b5dcdf4d37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1553628474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b62aac-650e-49cf-8821-ab8193c15ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863dbf06c9a845c692ec650733bb4dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:25:35Z,use_quota=True,user_id='676f35dff47942089f431eb757e0888e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba6a937-6cef-44fb-a0c0-58ad9be0ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba6a937-6cef-44fb-a0c0-58ad9be0ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e4f5d4-2f8c-43a5-a724-566ad59923d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e4f5d4-2f8c-43a5-a724-566ad59923d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b62aac-650e-49cf-8821-ab8193c15ea1', 'volume_name': 'volume-48b62aac-650e-49cf-8821-ab8193c15ea1', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e79235-1522-4ad5-9828-bf878c544663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e79235-1522-4ad5-9828-bf878c544663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82398d06-d2f7-42e9-b1d0-1a490d114ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:25:35 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Volume 48b62aac-650e-49cf-8821-ab8193c15ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b62aac-650e-49cf-8821-ab8193c15ea1', 'volume_size': 1} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1553628474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b62aac-650e-49cf-8821-ab8193c15ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863dbf06c9a845c692ec650733bb4dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:25:35Z,use_quota=True,user_id='676f35dff47942089f431eb757e0888e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Creating volume 48b62aac-650e-49cf-8821-ab8193c15ea1 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:25:35 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:25:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:35 devstack quobyte-client[83260]: System call of process 87666 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:25:35 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=28, name=volume-48b62aac-650e-49cf-8821-ab8193c15ea1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1 1073741824" returned: 0 in 0.539s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1" returned: 0 in 0.172s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] <== create_volume: return (802ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82398d06-d2f7-42e9-b1d0-1a490d114ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b62aac-650e-49cf-8821-ab8193c15ea1', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093b3169-66a9-4593-aebc-56a9a054b4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:25:36 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Volume volume-48b62aac-650e-49cf-8821-ab8193c15ea1 (48b62aac-650e-49cf-8821-ab8193c15ea1): created successfully Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093b3169-66a9-4593-aebc-56a9a054b4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:25:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Flow 'volume_create_manager' (38275308-a355-4797-8469-c7e8f8985af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:25:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-df735474-5219-4917-8d16-77832309798c tempest-VolumeQuotasNegativeTestJSON-724660277 None] Created volume successfully. Sep 10 13:25:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-71e95d9b-583c-4ee7-90a7-b6d5dde8be13 req-5b75671a-a7b0-482d-a97c-8c21eee6bf03 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:25:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Acquiring lock "cinder-48b62aac-650e-49cf-8821-ab8193c15ea1-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:25:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "cinder-48b62aac-650e-49cf-8821-ab8193c15ea1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:25:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-71e95d9b-583c-4ee7-90a7-b6d5dde8be13 req-5b75671a-a7b0-482d-a97c-8c21eee6bf03 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:25:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-71e95d9b-583c-4ee7-90a7-b6d5dde8be13 req-5b75671a-a7b0-482d-a97c-8c21eee6bf03 tempest-AttachVolumeShelveTestJSON-1870643907 None] Terminate volume connection completed successfully. Sep 10 13:25:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-71e95d9b-583c-4ee7-90a7-b6d5dde8be13 req-5b75671a-a7b0-482d-a97c-8c21eee6bf03 tempest-AttachVolumeShelveTestJSON-1870643907 None] Deleting attachment 4b183f64-395a-4768-961b-518ef8ca26f6. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:25:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:25:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Acquiring lock "cinder-quobyte-48b62aac-650e-49cf-8821-ab8193c15ea1" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:25:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "cinder-quobyte-48b62aac-650e-49cf-8821-ab8193c15ea1" acquired by "delete_volume" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:25:38 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa04e0a-a536-4ecb-a036-935ff2f7fa23]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:25:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1" returned: 0 in 0.438s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48b62aac-650e-49cf-8821-ab8193c15ea1" returned: 0 in 0.083s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "cinder-quobyte-48b62aac-650e-49cf-8821-ab8193c15ea1" released by "delete_volume" :: held 0.687s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Created reservations ['584c755f-4e42-4fb5-86f7-e31da25a95c9', 'bf4e65ba-7fed-427c-b32a-f0ee46f53e8d', 'a1e8aabe-b90c-472a-88c3-369f0f69ce2d', '63cdbc84-6d11-4fa3-92b7-77aeb20ff054'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:25:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.071s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:40 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:25:40 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Deleted volume successfully. Sep 10 13:25:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-151f782c-8613-40e8-b68d-85f4abcb129b tempest-VolumeQuotasNegativeTestJSON-724660277 None] Lock "cinder-48b62aac-650e-49cf-8821-ab8193c15ea1-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:25:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Acquiring lock "cinder-31cc429e-9102-4b34-bb74-b59aa8980832-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:25:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "cinder-31cc429e-9102-4b34-bb74-b59aa8980832-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:25:44 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:25:44 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Acquiring lock "cinder-quobyte-31cc429e-9102-4b34-bb74-b59aa8980832" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:25:44 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "cinder-quobyte-31cc429e-9102-4b34-bb74-b59aa8980832" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:25:44 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb861e0-abe9-4c54-8c86-c397d86069fc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:25:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832" returned: 0 in 0.598s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-31cc429e-9102-4b34-bb74-b59aa8980832" returned: 0 in 0.229s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "cinder-quobyte-31cc429e-9102-4b34-bb74-b59aa8980832" released by "delete_volume" :: held 1.092s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Created reservations ['75c68ed8-fade-4475-8a78-1c6b680ad61c', '1ef2a6e6-b65b-4fd6-96e8-8963f5aa282e', '1cb4ff9b-fc79-45d2-bdd3-c1098cee307c', '741b9b61-37f0-4bbe-b13e-74f9085e30f3'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:25:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:25:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.222s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:25:46 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:25:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Deleted volume successfully. Sep 10 13:25:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a11bb2f-c7a7-464c-8ad5-50376c2469fe tempest-AttachSCSIVolumeTestJSON-158970712 None] Lock "cinder-31cc429e-9102-4b34-bb74-b59aa8980832-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:25:55 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=17,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:25:56 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=9,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.132s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:26:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:26:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:26:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:26:52 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Flow 'volume_create_manager' (44d3d9e7-a4c8-42e7-9e9d-bee62a23ab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacf4590-d712-4304-bcb6-cc8eacca261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacf4590-d712-4304-bcb6-cc8eacca261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1632217334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ad14c66d448898e5f869d191463b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:26:52Z,use_quota=True,user_id='16ba9be40b57485aa06da803c73ec995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8817d4d9-8902-4de9-8e5d-2059538b8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8817d4d9-8902-4de9-8e5d-2059538b8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c617757-8d73-4552-9268-fdb2066037a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c617757-8d73-4552-9268-fdb2066037a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7', 'volume_name': 'volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81a00b2-de3f-447d-a776-d7e9aefa4d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81a00b2-de3f-447d-a776-d7e9aefa4d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a5116a-f29e-420b-b3f9-4b59021a52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:26:52 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Volume 5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7', 'volume_size': 1} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1632217334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ad14c66d448898e5f869d191463b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:26:52Z,use_quota=True,user_id='16ba9be40b57485aa06da803c73ec995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Creating volume 5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:26:52 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:26:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:26:53 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=29, name=volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:26:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 1073741824" returned: 0 in 0.583s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:26:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:26:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7" returned: 0 in 0.259s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:26:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] <== create_volume: return (973ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:26:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:26:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a5116a-f29e-420b-b3f9-4b59021a52fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:26:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da9c509-697c-474c-8839-8c4d5c1b7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:26:54 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Volume volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 (5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7): created successfully Sep 10 13:26:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da9c509-697c-474c-8839-8c4d5c1b7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:26:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Flow 'volume_create_manager' (44d3d9e7-a4c8-42e7-9e9d-bee62a23ab7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:26:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ec1426fa-f490-4055-ba1c-c7a1380f1e62 tempest-TaggedAttachmentsTest-1162609647 None] Created volume successfully. Sep 10 13:27:04 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:27:04 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.337s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:27:16 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (7955be0d-463b-478d-bb59-31fc31f204bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ccdba8-8b82-4215-b9ae-ad0063db6ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ccdba8-8b82-4215-b9ae-ad0063db6ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-356904459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0bd300-9f17-4a6d-84b8-f05a899e989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:16Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448ffc00-efa7-4633-b1eb-da31f530b440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448ffc00-efa7-4633-b1eb-da31f530b440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f983961-9868-4ef0-94fa-47113a20e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f983961-9868-4ef0-94fa-47113a20e26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0bd300-9f17-4a6d-84b8-f05a899e989d', 'volume_name': 'volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0005d3bf-bd8d-433a-ba8d-792afdb992ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0005d3bf-bd8d-433a-ba8d-792afdb992ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5add6ab7-ca01-4162-b606-94cbe17ae4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:16 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Volume 9e0bd300-9f17-4a6d-84b8-f05a899e989d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d', 'volume_size': 1} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-356904459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0bd300-9f17-4a6d-84b8-f05a899e989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:16Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Creating volume 9e0bd300-9f17-4a6d-84b8-f05a899e989d {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:27:16 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:27:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:16 devstack quobyte-client[83260]: System call of process 88044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:27:17 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=30, name=volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:27:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d 1073741824" returned: 0 in 0.969s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d" returned: 0 in 0.268s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] <== create_volume: return (1403ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:27:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5add6ab7-ca01-4162-b606-94cbe17ae4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091544b7-fb78-4c93-95e0-ad469d91ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:19 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Volume volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d (9e0bd300-9f17-4a6d-84b8-f05a899e989d): created successfully Sep 10 13:27:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091544b7-fb78-4c93-95e0-ad469d91ee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (7955be0d-463b-478d-bb59-31fc31f204bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:19 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ebd52c9d-c765-4c76-8b79-a8e4c36189eb tempest-VolumesActionsTest-560260197 None] Created volume successfully. Sep 10 13:27:20 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fea5ba4e-864c-4132-b23a-b5d71701bcd0 tempest-VolumesActionsTest-560260197 None] Acquiring lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d" by "attach_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:20 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fea5ba4e-864c-4132-b23a-b5d71701bcd0 tempest-VolumesActionsTest-560260197 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d" acquired by "attach_volume" :: waited 0.142s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:21 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-fea5ba4e-864c-4132-b23a-b5d71701bcd0 tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:21 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-fea5ba4e-864c-4132-b23a-b5d71701bcd0 tempest-VolumesActionsTest-560260197 None] Attaching volume 9e0bd300-9f17-4a6d-84b8-f05a899e989d to instance 825ec636-53e3-4121-b10d-962275e7eedc at mountpoint /dev/vdb on host None. Sep 10 13:27:21 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-fea5ba4e-864c-4132-b23a-b5d71701bcd0 tempest-VolumesActionsTest-560260197 None] Attach volume completed successfully. Sep 10 13:27:21 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fea5ba4e-864c-4132-b23a-b5d71701bcd0 tempest-VolumesActionsTest-560260197 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d" released by "attach_volume" :: held 0.822s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:23 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Terminate volume connection completed successfully. Sep 10 13:27:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-detach_volume" by "detach_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:23 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Detaching volume 9e0bd300-9f17-4a6d-84b8-f05a899e989d from instance 825ec636-53e3-4121-b10d-962275e7eedc. Sep 10 13:27:23 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:24 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Detach volume completed successfully. Sep 10 13:27:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-076ab56f-fbd5-4bd4-b690-0bbcd2b48d64 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-detach_volume" released by "detach_volume" :: held 0.197s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a71c14b-c891-4f0f-ba3c-210bca50048f tempest-VolumesActionsTest-560260197 None] Acquiring lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-detach_volume" by "detach_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a71c14b-c891-4f0f-ba3c-210bca50048f tempest-VolumesActionsTest-560260197 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-detach_volume" acquired by "detach_volume" :: waited 0.123s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:25 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1a71c14b-c891-4f0f-ba3c-210bca50048f tempest-VolumesActionsTest-560260197 None] Volume detach called, but volume not attached. Sep 10 13:27:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1a71c14b-c891-4f0f-ba3c-210bca50048f tempest-VolumesActionsTest-560260197 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Acquiring lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Acquiring lock "cinder-quobyte-9e0bd300-9f17-4a6d-84b8-f05a899e989d" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Lock "cinder-quobyte-9e0bd300-9f17-4a6d-84b8-f05a899e989d" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:26 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51714d4c-d1df-4453-8bad-345a990fa72a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:27:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:27 devstack quobyte-client[83260]: System call of process 88144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:27:27 devstack quobyte-client[83260]: System call of process 88144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:27:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d" returned: 0 in 1.314s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e0bd300-9f17-4a6d-84b8-f05a899e989d" returned: 0 in 0.124s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Lock "cinder-quobyte-9e0bd300-9f17-4a6d-84b8-f05a899e989d" released by "delete_volume" :: held 1.765s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:28 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Created reservations ['4543aca4-df60-4e74-a16e-83fd17c561dd', '3f27eecd-1bca-4550-a182-82db75105aab', 'e8f971db-b4d1-4a62-93fc-fecfdf3ccc66', '73b080b3-bc61-4fe8-b96d-9e5266f5a027'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.200s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:27:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Deleted volume successfully. Sep 10 13:27:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-80c3b01d-349f-4724-9f66-47e95f80e4d8 tempest-VolumesActionsTest-560260197 None] Lock "cinder-9e0bd300-9f17-4a6d-84b8-f05a899e989d-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:38 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=18,cinder:UPDATE=15,cinder:INSERT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:27:39 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=12,cinder:SELECT=9,cinder:DELETE=2,cinder:INSERT=5 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:27:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:40 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (ce355dd5-6220-45ad-9ee4-8086fa2500bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e29bfe-4e83-45ea-b1b0-3eb9d60491eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e29bfe-4e83-45ea-b1b0-3eb9d60491eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-484459420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce1c8a2-c841-4de3-8d1c-4bc832594832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:41Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477c1817-a918-4336-ba66-1e1b1dc27174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477c1817-a918-4336-ba66-1e1b1dc27174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f5dd28-0b07-41d4-917c-fbec05249318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f5dd28-0b07-41d4-917c-fbec05249318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce1c8a2-c841-4de3-8d1c-4bc832594832', 'volume_name': 'volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a936dd72-5724-406b-8749-70dab4c7063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a936dd72-5724-406b-8749-70dab4c7063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dd8b71-e898-4238-9cd1-a455dc5fd719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Volume 4ce1c8a2-c841-4de3-8d1c-4bc832594832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832', 'volume_size': 1} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-484459420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce1c8a2-c841-4de3-8d1c-4bc832594832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:41Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Creating volume 4ce1c8a2-c841-4de3-8d1c-4bc832594832 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:27:41 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:41 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=31, name=volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832 1073741824" returned: 0 in 0.398s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832" returned: 0 in 0.090s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] <== create_volume: return (558ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:27:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.571s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dd8b71-e898-4238-9cd1-a455dc5fd719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a60b62-3ec0-4be2-bf51-8387c0c81ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:42 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Volume volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832 (4ce1c8a2-c841-4de3-8d1c-4bc832594832): created successfully Sep 10 13:27:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a60b62-3ec0-4be2-bf51-8387c0c81ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (ce355dd5-6220-45ad-9ee4-8086fa2500bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b7f241bd-263d-49da-8f37-e6093ef10baf tempest-VolumesActionsTest-560260197 None] Created volume successfully. Sep 10 13:27:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-4ce1c8a2-c841-4de3-8d1c-4bc832594832-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Lock "cinder-4ce1c8a2-c841-4de3-8d1c-4bc832594832-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:43 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-quobyte-4ce1c8a2-c841-4de3-8d1c-4bc832594832" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-4ce1c8a2-c841-4de3-8d1c-4bc832594832" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1304a58f-7794-4333-b3a8-a8be1e2e2eb2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:27:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832" returned: 0 in 0.687s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4ce1c8a2-c841-4de3-8d1c-4bc832594832" returned: 0 in 0.202s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:44 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-4ce1c8a2-c841-4de3-8d1c-4bc832594832" released by "delete_volume" :: held 1.084s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Created reservations ['843f607c-8b86-481a-aaba-1b03de95c78f', '11838595-09cb-407c-bd7e-df66de7cc0c2', 'a43c0ccb-42b8-4804-87c4-7a3c2d477f7b', 'a848fc2a-c788-4d86-bee9-dea5d5372a02'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.123s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:45 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:27:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Deleted volume successfully. Sep 10 13:27:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2b0cfe77-a933-4cbb-8f2d-b62ca8a78fde tempest-VolumesActionsTest-1264457210 None] Lock "cinder-4ce1c8a2-c841-4de3-8d1c-4bc832594832-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (71007863-bbd8-42d8-b355-c5710ead9fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df9759f-b016-4553-a26d-618fccb08503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df9759f-b016-4553-a26d-618fccb08503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2096112945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080f80da-5c8c-48b9-be52-896b46b20baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:47Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afea382-e46f-4f41-be75-a00d727906ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afea382-e46f-4f41-be75-a00d727906ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb1233b-5956-4e04-a3cb-8a9dd0e3c0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb1233b-5956-4e04-a3cb-8a9dd0e3c0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080f80da-5c8c-48b9-be52-896b46b20baf', 'volume_name': 'volume-080f80da-5c8c-48b9-be52-896b46b20baf', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc21a2b-74bb-4956-8f38-abbec40ee9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc21a2b-74bb-4956-8f38-abbec40ee9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbb1b4c-87db-42e0-8584-4d253216bf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:47 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Volume 080f80da-5c8c-48b9-be52-896b46b20baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080f80da-5c8c-48b9-be52-896b46b20baf', 'volume_size': 1} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2096112945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080f80da-5c8c-48b9-be52-896b46b20baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:47Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Creating volume 080f80da-5c8c-48b9-be52-896b46b20baf {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:27:47 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:27:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:47 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=32, name=volume-080f80da-5c8c-48b9-be52-896b46b20baf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf 1073741824" returned: 0 in 0.619s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf" returned: 0 in 0.257s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] <== create_volume: return (1028ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbb1b4c-87db-42e0-8584-4d253216bf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080f80da-5c8c-48b9-be52-896b46b20baf', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9266e891-2019-4d80-9159-35501a553636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Volume volume-080f80da-5c8c-48b9-be52-896b46b20baf (080f80da-5c8c-48b9-be52-896b46b20baf): created successfully Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9266e891-2019-4d80-9159-35501a553636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (71007863-bbd8-42d8-b355-c5710ead9fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:48 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c9fef5ca-a89c-4875-8f39-da56b098a045 tempest-VolumesActionsTest-560260197 None] Created volume successfully. Sep 10 13:27:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-080f80da-5c8c-48b9-be52-896b46b20baf-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-080f80da-5c8c-48b9-be52-896b46b20baf-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-quobyte-080f80da-5c8c-48b9-be52-896b46b20baf" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-080f80da-5c8c-48b9-be52-896b46b20baf" acquired by "delete_volume" :: waited 0.026s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:50 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2479073-e78e-4ec2-ad44-7a6a5ad3c0a0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:27:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:50 devstack quobyte-client[83260]: System call of process 88318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:27:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf" returned: 0 in 0.808s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-080f80da-5c8c-48b9-be52-896b46b20baf" returned: 0 in 0.134s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-080f80da-5c8c-48b9-be52-896b46b20baf" released by "delete_volume" :: held 1.200s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Created reservations ['66938d52-836c-439f-9e16-cd775ce5df77', 'f9eece38-4a85-4c7e-b831-12fa8c844dc2', 'b6ad92c4-327d-4aa7-b2d9-e23e0badeb75', 'f696f5f4-3a64-44cf-b544-5425edaa12d6'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.157s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:52 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:27:52 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Deleted volume successfully. Sep 10 13:27:52 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5f871d4c-86a9-4ef3-81c5-512af56a5043 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-080f80da-5c8c-48b9-be52-896b46b20baf-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:53 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (cead718e-e0a9-4877-8d22-1be2ee3a5645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916d1760-903d-46a4-84be-0f641881778e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916d1760-903d-46a4-84be-0f641881778e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064599387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6f4641-3737-4361-b933-92cb1cbcaa82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:53Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042c0dda-e00c-4bb1-96e9-c16d5d1d2981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042c0dda-e00c-4bb1-96e9-c16d5d1d2981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d625b94d-d9ac-49fa-9578-33fb8275537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d625b94d-d9ac-49fa-9578-33fb8275537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6f4641-3737-4361-b933-92cb1cbcaa82', 'volume_name': 'volume-fd6f4641-3737-4361-b933-92cb1cbcaa82', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6cdb99-da13-4a25-abe7-507d2a5ceded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6cdb99-da13-4a25-abe7-507d2a5ceded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e7575f-3dca-46d0-90b3-45a7304a40d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:53 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Volume fd6f4641-3737-4361-b933-92cb1cbcaa82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6f4641-3737-4361-b933-92cb1cbcaa82', 'volume_size': 1} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064599387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6f4641-3737-4361-b933-92cb1cbcaa82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:27:53Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Creating volume fd6f4641-3737-4361-b933-92cb1cbcaa82 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:27:53 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:27:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:53 devstack quobyte-client[83260]: System call of process 88331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:27:53 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=33, name=volume-fd6f4641-3737-4361-b933-92cb1cbcaa82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82 1073741824" returned: 0 in 0.453s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82" returned: 0 in 0.249s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] <== create_volume: return (832ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e7575f-3dca-46d0-90b3-45a7304a40d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6f4641-3737-4361-b933-92cb1cbcaa82', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3752e5-f038-4194-b67b-ecf23505777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:27:54 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Volume volume-fd6f4641-3737-4361-b933-92cb1cbcaa82 (fd6f4641-3737-4361-b933-92cb1cbcaa82): created successfully Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3752e5-f038-4194-b67b-ecf23505777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:27:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (cead718e-e0a9-4877-8d22-1be2ee3a5645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:27:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-48c582cd-c1ad-47c8-b952-4caf99e3ac8f tempest-VolumesActionsTest-560260197 None] Created volume successfully. Sep 10 13:27:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-fd6f4641-3737-4361-b933-92cb1cbcaa82-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-fd6f4641-3737-4361-b933-92cb1cbcaa82-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:56 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:27:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-quobyte-fd6f4641-3737-4361-b933-92cb1cbcaa82" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:27:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-fd6f4641-3737-4361-b933-92cb1cbcaa82" acquired by "delete_volume" :: waited 0.012s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:27:56 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1469be15-7a59-4c70-a7e1-86240d34360f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:27:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:57 devstack quobyte-client[83260]: System call of process 88345 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:27:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82" returned: 0 in 0.714s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fd6f4641-3737-4361-b933-92cb1cbcaa82" returned: 0 in 0.342s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-fd6f4641-3737-4361-b933-92cb1cbcaa82" released by "delete_volume" :: held 1.602s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:27:58 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Created reservations ['c6e72914-d45e-42e0-987c-1aec971cf72c', '75f51bf8-ac43-48fc-858d-412b3e457a3a', '232f1b66-22f9-464c-a024-55a6f1477bef', '8b7fc315-1eb6-48c0-a0e4-a60681c1c4ea'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.165s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:27:59 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Deleted volume successfully. Sep 10 13:27:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-651f3632-7733-422b-bfee-1b738b335eb7 tempest-VolumesActionsTest-1264457210 None] Lock "cinder-fd6f4641-3737-4361-b933-92cb1cbcaa82-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:28:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (0f4f69fe-02c8-455e-9c5f-3046b186dee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b83d9e-b146-4daf-9552-badb28e09136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b83d9e-b146-4daf-9552-badb28e09136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738157135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:00Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683a7244-8ea8-41e2-8fef-7a2b15aa4e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683a7244-8ea8-41e2-8fef-7a2b15aa4e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b0a8ba-67a3-4017-9df2-919c90de2263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b0a8ba-67a3-4017-9df2-919c90de2263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e', 'volume_name': 'volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44a314c-4080-4773-b040-f8d9b2108590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44a314c-4080-4773-b040-f8d9b2108590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b4800-e0cf-47cb-ae82-94767e60a94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:00 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Volume 1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e', 'volume_size': 1} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738157135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:00Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Creating volume 1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:28:00 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:28:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:00 devstack quobyte-client[83260]: System call of process 88353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:28:00 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=34, name=volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e 1073741824" returned: 0 in 0.591s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e" returned: 0 in 0.138s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] <== create_volume: return (880ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b4800-e0cf-47cb-ae82-94767e60a94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6622c4b1-c12c-4fb6-9bb6-d1603f1d1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:01 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Volume volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e (1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e): created successfully Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6622c4b1-c12c-4fb6-9bb6-d1603f1d1906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (0f4f69fe-02c8-455e-9c5f-3046b186dee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:02 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f769c8ec-b9c3-4af0-844f-3bc380fe1358 tempest-VolumesActionsTest-560260197 None] Created volume successfully. Sep 10 13:28:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:28:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Lock "cinder-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:28:03 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Acquiring lock "cinder-quobyte-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:28:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e" acquired by "delete_volume" :: waited 0.031s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:28:03 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[592ffc9e-989e-42a6-897f-427aafe250ee]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e" returned: 0 in 0.957s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e" returned: 0 in 0.464s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Lock "cinder-quobyte-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e" released by "delete_volume" :: held 1.665s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:28:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Flow 'volume_create_manager' (1cd8a7a5-23ba-41c1-abe2-c2edbef2f54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ce16f4-60cf-4aca-8bef-3b48cfe0e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ce16f4-60cf-4aca-8bef-3b48cfe0e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1580955403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3727039-e20a-489e-ab08-86951dd662a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb52e624818c4bb4a324b676f53033e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:05Z,use_quota=True,user_id='737be8267e77422e9d0b6e46f58915ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6291961-c374-42ee-bf67-0f610cdfb31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6291961-c374-42ee-bf67-0f610cdfb31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8168b6d9-8f8b-4bac-b74c-b76ca84ebc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8168b6d9-8f8b-4bac-b74c-b76ca84ebc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3727039-e20a-489e-ab08-86951dd662a3', 'volume_name': 'volume-f3727039-e20a-489e-ab08-86951dd662a3', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7af0ceb-e6ab-481f-9f67-ea601b3b820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7af0ceb-e6ab-481f-9f67-ea601b3b820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684ef8c3-fc0c-4d84-981f-85f6bdbb67bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:05 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume f3727039-e20a-489e-ab08-86951dd662a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3727039-e20a-489e-ab08-86951dd662a3', 'volume_size': 1} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1580955403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3727039-e20a-489e-ab08-86951dd662a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb52e624818c4bb4a324b676f53033e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:05Z,use_quota=True,user_id='737be8267e77422e9d0b6e46f58915ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Creating volume f3727039-e20a-489e-ab08-86951dd662a3 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:28:05 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:28:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:05 devstack quobyte-client[83260]: System call of process 88363 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:28:05 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=35, name=volume-f3727039-e20a-489e-ab08-86951dd662a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Created reservations ['4276fca0-6b54-4eed-85fa-aec0938ef52a', '7199b118-499a-4e70-b042-31f8da3273ee', 'c1a78cb1-6e57-4e58-a502-6e36c7bd99df', '14b73183-c647-4a2b-95ec-826078d2feee'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3 1073741824" returned: 0 in 0.792s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3" returned: 0 in 0.305s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] <== create_volume: return (1169ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684ef8c3-fc0c-4d84-981f-85f6bdbb67bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3727039-e20a-489e-ab08-86951dd662a3', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38f320a-13d1-4ca0-92aa-a960cdf0dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.613s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:28:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Deleted volume successfully. Sep 10 13:28:07 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume volume-f3727039-e20a-489e-ab08-86951dd662a3 (f3727039-e20a-489e-ab08-86951dd662a3): created successfully Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38f320a-13d1-4ca0-92aa-a960cdf0dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Flow 'volume_create_manager' (1cd8a7a5-23ba-41c1-abe2-c2edbef2f54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d9ab2fd6-4475-4f17-82c9-ffcfc15fe109 tempest-AttachVolumeShelveTestJSON-1870643907 None] Created volume successfully. Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d3382509-efd3-48ac-bb2d-a9474835e35a tempest-VolumesActionsTest-1264457210 None] Lock "cinder-1e6fd1b0-6ec0-4f33-b9db-4a4fbb48fe5e-delete_volume" released by "delete_volume" :: held 4.069s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:28:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (f730870f-f09e-47eb-a7fd-fadd18c8a6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c20c4d-2850-4a1f-9a4b-6fa6fbf3f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c20c4d-2850-4a1f-9a4b-6fa6fbf3f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-268313227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:08Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a055f341-95f8-40d3-8031-01c67753fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a055f341-95f8-40d3-8031-01c67753fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5034408d-c313-43b8-a4e1-9081ad25a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5034408d-c313-43b8-a4e1-9081ad25a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97', 'volume_name': 'volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2dfabe-0542-487d-8c2e-78f9d5389aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2dfabe-0542-487d-8c2e-78f9d5389aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0da4108-4cb0-4994-810a-9b2ee9a149b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:07 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Volume df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97', 'volume_size': 1} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-268313227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9ff23a47b46e6aca210bc307d2687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:08Z,use_quota=True,user_id='5529a61294a540018750ecceb5b25723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Creating volume df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:28:07 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:28:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:08 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=36, name=volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97 1073741824" returned: 0 in 0.439s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97" returned: 0 in 0.133s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.648s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0da4108-4cb0-4994-810a-9b2ee9a149b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54afd22e-8f69-40e1-b70f-8176eb000be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:08 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Volume volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97 (df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97): created successfully Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54afd22e-8f69-40e1-b70f-8176eb000be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Flow 'volume_create_manager' (f730870f-f09e-47eb-a7fd-fadd18c8a6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:08 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a519b688-ed50-4426-bbe5-cecc2215b508 tempest-VolumesActionsTest-560260197 None] Created volume successfully. Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.384s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:28:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Acquiring lock "cinder-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:28:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Lock "cinder-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:28:12 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Acquiring lock "cinder-quobyte-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:28:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Lock "cinder-quobyte-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97" acquired by "delete_volume" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:28:12 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cabafbc-963e-4494-b8fc-aa1da04409bc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97" returned: 0 in 0.544s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97" returned: 0 in 0.085s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Lock "cinder-quobyte-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97" released by "delete_volume" :: held 0.808s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:28:13 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Created reservations ['e159f794-b61c-4ebf-958b-383a931cb4d3', '92773fda-244e-436b-91ca-4aa023a6a68f', '8351839e-a66c-4782-bb84-c1dcc8976ec2', 'a10861e0-450d-4632-83e3-dcf7990dac67'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:28:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:28:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:28:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.597s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:15 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:28:15 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Deleted volume successfully. Sep 10 13:28:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-425a1461-f22a-408a-a379-3d76d45b6c46 tempest-VolumesActionsTest-560260197 None] Lock "cinder-df6b2d5f-39b4-497a-bdc8-e18ca2b0ab97-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:28:24 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=51,cinder:SELECT=29,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:28:25 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=34,cinder:UPDATE=54,cinder:DELETE=8,cinder:INSERT=16 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:28:34 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-b0c3799f-11c6-47f9-878a-20f82b099dd4 req-88618905-e27b-4bae-9d37-2f9a7353403c tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:35 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-b0c3799f-11c6-47f9-878a-20f82b099dd4 req-88618905-e27b-4bae-9d37-2f9a7353403c tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-b0c3799f-11c6-47f9-878a-20f82b099dd4 req-88618905-e27b-4bae-9d37-2f9a7353403c tempest-AttachVolumeShelveTestJSON-1870643907 None] No connector for attachment a5462ccb-2945-4f27-8648-72977ff31672; skipping storage backend terminate_connection call. {{(pid=83206) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 10 13:28:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-b0c3799f-11c6-47f9-878a-20f82b099dd4 req-88618905-e27b-4bae-9d37-2f9a7353403c tempest-AttachVolumeShelveTestJSON-1870643907 None] Deleting attachment a5462ccb-2945-4f27-8648-72977ff31672. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:28:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:40 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:28:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Flow 'volume_create_manager' (d37cd3f3-2ed3-4c92-aaff-793245ac8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e238361e-5c0b-4c01-8057-6a090423e70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e238361e-5c0b-4c01-8057-6a090423e70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1906611173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9a67ae-9df1-4878-9a3a-a866b41ea14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144e5d25bdc14b289620c7d1b8f4bd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:41Z,use_quota=True,user_id='634bac7f2dd9471aa83976187798b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded97b4c-f2f5-42fa-924f-0885cf03ff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded97b4c-f2f5-42fa-924f-0885cf03ff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e53eb95-3b73-4ac5-aef3-048fc1540b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e53eb95-3b73-4ac5-aef3-048fc1540b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e9a67ae-9df1-4878-9a3a-a866b41ea14b', 'volume_name': 'volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c761744-7e12-4f1b-808f-3798f4bf3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c761744-7e12-4f1b-808f-3798f4bf3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee4e292-ff9d-426b-876b-679b9b4668f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Volume 4e9a67ae-9df1-4878-9a3a-a866b41ea14b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Cloning 4e9a67ae-9df1-4878-9a3a-a866b41ea14b from image 63abeada-c2a5-416e-b79d-1e59204999db at location (None, None). {{(pid=83206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 13:28:41 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Image download 20.69 MB at 20.69 MB/s Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c762fd-fdd1-49ce-ae18-b2f5367c5bfb]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:42 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD Sep 10 13:28:42 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:28:43 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Sep 10 13:28:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD" returned: 0 in 2.068s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:43 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db is fetched for user 634bac7f2dd9471aa83976187798b99b. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 13:28:44 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2165d92f-ff57-4d3c-b080-b5ea9f54d8b0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:44 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD Sep 10 13:28:44 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:28:46 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD" returned: 0 in 2.349s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1906611173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9a67ae-9df1-4878-9a3a-a866b41ea14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144e5d25bdc14b289620c7d1b8f4bd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:28:41Z,use_quota=True,user_id='634bac7f2dd9471aa83976187798b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Creating volume 4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:28:46 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:28:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:46 devstack quobyte-client[83260]: System call of process 88553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:28:46 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=37, name=volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:28:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b 1073741824" returned: 0 in 0.360s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" returned: 0 in 0.139s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] <== create_volume: return (664ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:28:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:28:47 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Attempting download of 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume 4e9a67ae-9df1-4878-9a3a-a866b41ea14b. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 13:28:48 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[132bba30-160a-496c-aae5-69aa5ccfb7d0]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_2k73nq9o {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_2k73nq9o" returned: 0 in 0.865s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_2k73nq9o {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_2k73nq9o" returned: 1 in 0.495s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_2k73nq9o' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:28:49 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[448bc283-52a0-4147-b23d-c894523808d1]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:50 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] 63abeada-c2a5-416e-b79d-1e59204999db was qcow2, converting to raw {{(pid=83206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 13:28:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:50 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=37, name=volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:28:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" returned: 0 in 1.971s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:52 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_6rx5vvsqdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:28:52 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Converted 112.00 MB image at 55.00 MB/s Sep 10 13:28:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b 1G" returned: 0 in 0.251s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:52 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[487c8d06-be18-459e-b59f-8bf24de0ef83]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:53 devstack quobyte-client[83260]: System call of process 88590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:28:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" returned: 0 in 0.551s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" returned: 1 in 0.835s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Downloaded image 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume 4e9a67ae-9df1-4878-9a3a-a866b41ea14b successfully. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db for user 634bac7f2dd9471aa83976187798b99b is deleted. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Marking volume 4e9a67ae-9df1-4878-9a3a-a866b41ea14b as bootable. {{(pid=83206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Copying metadata from image 63abeada-c2a5-416e-b79d-1e59204999db to 4e9a67ae-9df1-4878-9a3a-a866b41ea14b. {{(pid=83206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Creating volume glance metadata for volume 4e9a67ae-9df1-4878-9a3a-a866b41ea14b backed by image 63abeada-c2a5-416e-b79d-1e59204999db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee4e292-ff9d-426b-876b-679b9b4668f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3ddadf-bbc4-4c08-bc59-a50efad80638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:28:55 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Volume volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b (4e9a67ae-9df1-4878-9a3a-a866b41ea14b): created successfully Sep 10 13:28:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3ddadf-bbc4-4c08-bc59-a50efad80638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:28:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Flow 'volume_create_manager' (d37cd3f3-2ed3-4c92-aaff-793245ac8600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:28:55 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-33d0e7dd-95b1-417f-bba8-1f782dec81f6 tempest-VolumesImageMetadata-399573269 None] Created volume successfully. Sep 10 13:28:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Acquiring lock "cinder-4e9a67ae-9df1-4878-9a3a-a866b41ea14b-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:28:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Lock "cinder-4e9a67ae-9df1-4878-9a3a-a866b41ea14b-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:28:56 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:28:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Acquiring lock "cinder-quobyte-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:28:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Lock "cinder-quobyte-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" acquired by "delete_volume" :: waited 0.039s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:28:57 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a88b16-03e4-4d16-ab09-f557e6957944]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:28:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:28:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" returned: 0 in 1.196s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:28:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" returned: 1 in 1.493s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:29:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" returned: 0 in 0.394s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Lock "cinder-quobyte-4e9a67ae-9df1-4878-9a3a-a866b41ea14b" released by "delete_volume" :: held 4.019s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Created reservations ['a1f2bf7c-a1f8-4e3f-8090-c5df9e19cc21', '492460c7-0932-48f3-909b-6c21a1da0416', '32739ff8-43b0-4b56-a97e-4582c670abee', '7d67080b-34d2-45ca-9f37-9334a271ef9b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.121s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:02 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:29:02 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Deleted volume successfully. Sep 10 13:29:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88a03587-3808-4d3e-a5ed-b68e8c12ea27 tempest-VolumesImageMetadata-399573269 None] Lock "cinder-4e9a67ae-9df1-4878-9a3a-a866b41ea14b-delete_volume" released by "delete_volume" :: held 5.814s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Flow 'volume_create_manager' (74498755-3c50-4cea-a6b3-bfc5a8c65447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50eda4b7-946b-4a95-aa8c-099cdadd591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50eda4b7-946b-4a95-aa8c-099cdadd591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-961814367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2418d1ec-05ab-403b-acd3-4cc812ae0856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a820ae0dc8f6413eaf76002ff003014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:29:07Z,use_quota=True,user_id='a06ad3ab51f4440fbc2a911bdcb663c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36964af4-88b2-4d96-9d41-833791c36ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36964af4-88b2-4d96-9d41-833791c36ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95de41cd-51b9-4b39-a34d-bd4b0f7b6948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95de41cd-51b9-4b39-a34d-bd4b0f7b6948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2418d1ec-05ab-403b-acd3-4cc812ae0856', 'volume_name': 'volume-2418d1ec-05ab-403b-acd3-4cc812ae0856', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e60afa-19c9-419d-a694-e1babec8a933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e60afa-19c9-419d-a694-e1babec8a933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d297d39-57af-4410-b997-4d76c341f684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:07 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Volume 2418d1ec-05ab-403b-acd3-4cc812ae0856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2418d1ec-05ab-403b-acd3-4cc812ae0856', 'volume_size': 1} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-961814367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2418d1ec-05ab-403b-acd3-4cc812ae0856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a820ae0dc8f6413eaf76002ff003014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:29:07Z,use_quota=True,user_id='a06ad3ab51f4440fbc2a911bdcb663c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Creating volume 2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:29:07 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:29:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:07 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=38, name=volume-2418d1ec-05ab-403b-acd3-4cc812ae0856, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:29:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 1073741824" returned: 0 in 1.245s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856" returned: 0 in 0.345s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] <== create_volume: return (1703ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:29:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d297d39-57af-4410-b997-4d76c341f684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2418d1ec-05ab-403b-acd3-4cc812ae0856', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5f55bb-1340-44c5-80e9-02610f0d96e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:10 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Volume volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 (2418d1ec-05ab-403b-acd3-4cc812ae0856): created successfully Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5f55bb-1340-44c5-80e9-02610f0d96e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Flow 'volume_create_manager' (74498755-3c50-4cea-a6b3-bfc5a8c65447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:10 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b1d96a1d-9f2e-42d6-af93-802ade10973c tempest-VolumesDeleteCascade-1891016450 None] Created volume successfully. Sep 10 13:29:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 1.142s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:29:12 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Creating offline snapshot bbaea0eb-05cf-4941-b754-d22ffe4eb467 of volume 2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:29:12 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480d0fc-984b-4c94-8953-7016f0a2cd82]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856" returned: 0 in 1.434s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:14 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=39, name=volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:29:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 1G" returned: 0 in 0.540s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img rebase -u -b volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 0.300s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:29:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 0.131s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 0.215s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.info" returned: 0 in 0.276s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:29:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.info" returned: 0 in 0.247s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.139s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:17 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7c6db56a-74aa-4fd3-9998-afa5f6fa01f4 tempest-VolumesDeleteCascade-1891016450 None] Create snapshot completed successfully Sep 10 13:29:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Creating offline snapshot d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa of volume 2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:29:18 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c78f3db-e6fd-4563-a08d-be2a81172cb2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:20 devstack quobyte-client[83260]: System call of process 88797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 1.700s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2418d1ec-05ab-403b-acd3-4cc812ae0856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:29:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:21 devstack quobyte-client[83260]: System call of process 88805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:21 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=41, name=volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:29:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa 1G" returned: 0 in 1.004s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:22 devstack quobyte-client[83260]: System call of process 88810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img rebase -u -b volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" returned: 0 in 0.543s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" returned: 0 in 0.118s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" returned: 0 in 0.123s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.250s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ae0e7a8b-2bae-4697-8f0d-b336f50411cb tempest-VolumesDeleteCascade-1891016450 None] Create snapshot completed successfully Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-2418d1ec-05ab-403b-acd3-4cc812ae0856-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-2418d1ec-05ab-403b-acd3-4cc812ae0856-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Performing cascade delete. {{(pid=83206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-bbaea0eb-05cf-4941-b754-d22ffe4eb467-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-bbaea0eb-05cf-4941-b754-d22ffe4eb467-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-bbaea0eb-05cf-4941-b754-d22ffe4eb467" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-bbaea0eb-05cf-4941-b754-d22ffe4eb467" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Deleting offline snapshot bbaea0eb-05cf-4941-b754-d22ffe4eb467 of volume 2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] snapshot_file for this snap is: volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc67087-9665-4a1a-a7fc-37571344fc40]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 0.460s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2418d1ec-05ab-403b-acd3-4cc812ae0856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:29:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5246d-94fa-41d0-aef8-17c04cdd1438]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856" returned: 0 in 0.672s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:26 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f751793-87b5-4cb6-a8cb-4179245e9285]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" returned: 0 in 0.621s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2418d1ec-05ab-403b-acd3-4cc812ae0856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:29:26 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922451a-748d-4bd2-8023-dfd512a8a23e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:27 devstack quobyte-client[83260]: System call of process 88835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 0.809s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2418d1ec-05ab-403b-acd3-4cc812ae0856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:29:27 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7280f809-0d89-4038-94b8-1aaf261e5b66]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:28 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=24,cinder:UPDATE=16,cinder:INSERT=6,cinder:DELETE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:29:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:28 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c085aa62-206a-47d6-bec2-5ccca1e7d42e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856" returned: 0 in 0.907s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:28 devstack quobyte-client[83260]: System call of process 88843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:29 devstack quobyte-client[83260]: System call of process 88851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7" returned: 0 in 1.235s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.341s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 1.054s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.bbaea0eb-05cf-4941-b754-d22ffe4eb467" returned: 0 in 0.563s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa -F qcow2 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '763cd3f2-4cf4-4028-830a-3999cf6d34c6', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:29:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img rebase -u -b volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa -F qcow2" returned: 0 in 0.439s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-bbaea0eb-05cf-4941-b754-d22ffe4eb467" released by "_delete_snapshot" :: held 6.550s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" released by "delete_snapshot" :: held 6.590s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-e5256cc8-cbe1-4da7-bc5b-61ecca619a59 req-f91b0d40-ee34-4fa5-a3bb-63a633996cc1 tempest-TaggedAttachmentsTest-1162609647 None] attachment_update completed successfully. Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Created reservations ['99e83e03-dcf7-486e-8b51-b8c9fe36624f', 'c8525619-29c9-408f-b4b4-1876832f2b00', 'd4d88524-d897-4750-b7b8-5fb789eb3c9a', '288a69da-7a09-412b-885b-a614ef164b51'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:29:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Delete snapshot completed successfully. Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-bbaea0eb-05cf-4941-b754-d22ffe4eb467-delete_snapshot" released by "delete_snapshot" :: held 6.959s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Deleting offline snapshot d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa of volume 2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] snapshot_file for this snap is: volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f58a2a-f8a0-4b24-afc8-76d51dd9b102]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" returned: 0 in 0.528s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2418d1ec-05ab-403b-acd3-4cc812ae0856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:29:32 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daef707-e4fd-49fd-8f43-dff88ab6f10e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856" returned: 0 in 0.810s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" returned: 0 in 0.238s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856.d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" returned: 0 in 0.210s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa" released by "_delete_snapshot" :: held 2.131s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" released by "delete_snapshot" :: held 2.175s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Created reservations ['21a09d64-52df-4faf-acef-cd5a85f46be7', 'f02a07c8-0c40-4b3d-bd9d-c8b9a5b65b90', '3155903a-1e37-46cc-8425-15a827346598', '49f223f4-8082-42bd-b1e8-ed6175a97f4b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=31,cinder:INSERT=15,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:29:34 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Delete snapshot completed successfully. Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-d74130ed-4dff-4a4d-bf61-8bb3e83a2dfa-delete_snapshot" released by "delete_snapshot" :: held 2.843s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Snapshots deleted, issuing volume delete {{(pid=83206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" acquired by "delete_volume" :: waited 0.029s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a76c0e7-eaef-417f-ac7e-79c70cf3c64c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856" returned: 0 in 0.844s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2418d1ec-05ab-403b-acd3-4cc812ae0856" returned: 0 in 0.142s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-2418d1ec-05ab-403b-acd3-4cc812ae0856" released by "delete_volume" :: held 1.325s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Created reservations ['1db86d40-3458-4fd7-b12c-1e6ca7d644ec', '15572297-cb72-4390-87d6-17e0d438eb36', '5ed29cc6-c77a-4565-a6c2-d427053005a4', 'afb7e2ae-30a5-4402-ab26-c831ea9670a1'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.111s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:29:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Deleted volume successfully. Sep 10 13:29:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f565cfaf-f98e-4f63-a538-219c3021f8d7 tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-2418d1ec-05ab-403b-acd3-4cc812ae0856-delete_volume" released by "delete_volume" :: held 12.317s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Flow 'volume_create_manager' (c2b15225-8b5e-47da-a66c-75b78017f970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b02b48-9e94-4f55-b0bc-a955c2951b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b02b48-9e94-4f55-b0bc-a955c2951b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1021436571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b3bb05-0e17-4985-8bf0-d0322d80e674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a820ae0dc8f6413eaf76002ff003014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:29:38Z,use_quota=True,user_id='a06ad3ab51f4440fbc2a911bdcb663c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc3d618-29b1-4df0-8b60-1528531e0acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc3d618-29b1-4df0-8b60-1528531e0acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0ebbad-f1d3-47df-88ee-59e1897b4b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0ebbad-f1d3-47df-88ee-59e1897b4b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b3bb05-0e17-4985-8bf0-d0322d80e674', 'volume_name': 'volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3cc153-94f3-4bb3-b688-9fd3cb7bfa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3cc153-94f3-4bb3-b688-9fd3cb7bfa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd18589d-6c62-4a25-8a44-fcd90e1e87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:38 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Volume e4b3bb05-0e17-4985-8bf0-d0322d80e674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674', 'volume_size': 1} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1021436571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b3bb05-0e17-4985-8bf0-d0322d80e674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a820ae0dc8f6413eaf76002ff003014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:29:38Z,use_quota=True,user_id='a06ad3ab51f4440fbc2a911bdcb663c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Creating volume e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:29:38 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:29:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:38 devstack quobyte-client[83260]: System call of process 89290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:38 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=42, name=volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 1073741824" returned: 0 in 0.530s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674" returned: 0 in 0.218s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] <== create_volume: return (972ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd18589d-6c62-4a25-8a44-fcd90e1e87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237c729b-991a-4448-af8d-3c847d22d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:39 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Volume volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 (e4b3bb05-0e17-4985-8bf0-d0322d80e674): created successfully Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237c729b-991a-4448-af8d-3c847d22d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Flow 'volume_create_manager' (c2b15225-8b5e-47da-a66c-75b78017f970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:29:40 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7dfaedf0-297f-46ce-8601-5a1c99cd8060 tempest-VolumesDeleteCascade-1891016450 None] Created volume successfully. Sep 10 13:29:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Creating offline snapshot b826446a-4aed-4f8b-88db-fdfb4621fd86 of volume e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:29:41 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143f7b5-5a0c-4e1a-b40b-3c00ece745ff]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:41 devstack quobyte-client[83260]: System call of process 89299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:29:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674" returned: 0 in 0.741s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:42 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=43, name=volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 1G" returned: 0 in 0.360s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img rebase -u -b volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86" returned: 0 in 0.160s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86" returned: 0 in 0.212s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86" returned: 0 in 0.157s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.info" returned: 0 in 0.189s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:29:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.info" returned: 0 in 0.118s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:43 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-90783f45-41e1-44f3-8d99-7bc9737cd83e tempest-VolumesDeleteCascade-1891016450 None] Create snapshot completed successfully Sep 10 13:29:44 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:44 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Flow 'volume_create_manager' (779fbab8-8513-4788-9b83-deec37574c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9764141-d9de-44db-9df6-1e1d03fd43b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9764141-d9de-44db-9df6-1e1d03fd43b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1944897641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc21100-869f-4a8c-974b-396d292aae80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a820ae0dc8f6413eaf76002ff003014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b826446a-4aed-4f8b-88db-fdfb4621fd86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:29:45Z,use_quota=True,user_id='a06ad3ab51f4440fbc2a911bdcb663c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcb4e52-493f-4b0e-a065-8deafa78563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcb4e52-493f-4b0e-a065-8deafa78563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f52576-b64b-4ab5-89dd-40a39b9e4c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f52576-b64b-4ab5-89dd-40a39b9e4c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9fc21100-869f-4a8c-974b-396d292aae80', 'volume_name': 'volume-9fc21100-869f-4a8c-974b-396d292aae80', 'volume_size': 1, 'snapshot_id': 'b826446a-4aed-4f8b-88db-fdfb4621fd86'}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1ce541-ba04-4d50-8561-fcd3662eba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1ce541-ba04-4d50-8561-fcd3662eba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f23bdb-700d-44c0-9c58-88aebc4c281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:45 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Volume 9fc21100-869f-4a8c-974b-396d292aae80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9fc21100-869f-4a8c-974b-396d292aae80', 'volume_size': 1, 'snapshot_id': 'b826446a-4aed-4f8b-88db-fdfb4621fd86'} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-b826446a-4aed-4f8b-88db-fdfb4621fd86-9fc21100-869f-4a8c-974b-396d292aae80" by "_create_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-b826446a-4aed-4f8b-88db-fdfb4621fd86-9fc21100-869f-4a8c-974b-396d292aae80" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Creating volume 9fc21100-869f-4a8c-974b-396d292aae80 from snapshot b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-9fc21100-869f-4a8c-974b-396d292aae80" by "_copy_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-9fc21100-869f-4a8c-974b-396d292aae80" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] snapshot: b826446a-4aed-4f8b-88db-fdfb4621fd86, volume: 9fc21100-869f-4a8c-974b-396d292aae80, {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ebc4a-7614-4fd1-95ed-b371c0c61b58]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86" returned: 0 in 0.554s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Creating direct copy from snapshot {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 13:29:45 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d010ca-6c95-413b-ad46-2f716dea5b2a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674" returned: 0 in 0.529s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:46 devstack cinder-volume[83206]: DEBUG cinder.utils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80 not found in is_blk_device check {{(pid=83206) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 13:29:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:46 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=45, name=volume-9fc21100-869f-4a8c-974b-396d292aae80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:29:55 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:29:55 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:29:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80" returned: 0 in 9.695s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:56 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cbe4f2-bf62-4140-b029-f38ee28cb6f2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674" returned: 0 in 0.637s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Image conversion details: src /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80 {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:29:57 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Converted 1024.00 MB image at 105.26 MB/s Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-9fc21100-869f-4a8c-974b-396d292aae80" released by "_copy_volume_from_snapshot" :: held 11.907s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-b826446a-4aed-4f8b-88db-fdfb4621fd86-9fc21100-869f-4a8c-974b-396d292aae80" released by "_create_volume_from_snapshot" :: held 11.948s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.970s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f23bdb-700d-44c0-9c58-88aebc4c281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc21100-869f-4a8c-974b-396d292aae80', 'volume_size': 1, 'snapshot_id': 'b826446a-4aed-4f8b-88db-fdfb4621fd86'}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3621c2ba-4b03-4b1f-a800-97b3b3a64fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:29:57 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Volume volume-9fc21100-869f-4a8c-974b-396d292aae80 (9fc21100-869f-4a8c-974b-396d292aae80): created successfully Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3621c2ba-4b03-4b1f-a800-97b3b3a64fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:29:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Flow 'volume_create_manager' (779fbab8-8513-4788-9b83-deec37574c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:29:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-980e9946-ae40-41d9-926f-48457f7b383c tempest-VolumesDeleteCascade-1891016450 None] Created volume successfully. Sep 10 13:29:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-e4b3bb05-0e17-4985-8bf0-d0322d80e674-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-e4b3bb05-0e17-4985-8bf0-d0322d80e674-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Performing cascade delete. {{(pid=83206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-b826446a-4aed-4f8b-88db-fdfb4621fd86-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-b826446a-4aed-4f8b-88db-fdfb4621fd86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-e4b3bb05-0e17-4985-8bf0-d0322d80e674" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-e4b3bb05-0e17-4985-8bf0-d0322d80e674" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-b826446a-4aed-4f8b-88db-fdfb4621fd86" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-b826446a-4aed-4f8b-88db-fdfb4621fd86" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Deleting offline snapshot b826446a-4aed-4f8b-88db-fdfb4621fd86 of volume e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] snapshot_file for this snap is: volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e276ed78-12c4-40f3-9b84-b04687ffd624]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86" returned: 0 in 0.677s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab76710-1e56-4e76-91c4-1708e6d47af4]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:29:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:00 devstack quobyte-client[83260]: System call of process 89411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:30:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674" returned: 0 in 0.706s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86" returned: 0 in 0.233s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674.b826446a-4aed-4f8b-88db-fdfb4621fd86" returned: 0 in 0.084s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-b826446a-4aed-4f8b-88db-fdfb4621fd86" released by "_delete_snapshot" :: held 2.033s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-e4b3bb05-0e17-4985-8bf0-d0322d80e674" released by "delete_snapshot" :: held 2.077s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Created reservations ['472ee22f-e34f-4ad4-8bab-3ed67e305869', 'fc4e5d49-1fed-4d1d-9ce6-1edf68bb1383', 'b9865396-9715-47c1-a6ab-37efb6436174', 'a4adf104-89c8-45f6-b157-92418f8d930c'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:01 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Delete snapshot completed successfully. Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-b826446a-4aed-4f8b-88db-fdfb4621fd86-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Snapshots deleted, issuing volume delete {{(pid=83206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-e4b3bb05-0e17-4985-8bf0-d0322d80e674" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-e4b3bb05-0e17-4985-8bf0-d0322d80e674" acquired by "delete_volume" :: waited 0.028s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5304006-71b1-4ade-ab4b-ce07084c4867]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674" returned: 0 in 0.486s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e4b3bb05-0e17-4985-8bf0-d0322d80e674" returned: 0 in 0.116s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-e4b3bb05-0e17-4985-8bf0-d0322d80e674" released by "delete_volume" :: held 0.816s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Created reservations ['31f33b52-1816-4af0-bac9-dabe776fbea3', 'f6287ca7-cf59-4204-8577-31b860cb3b03', '86fcfc16-adef-4c48-a36e-6e5440dad0ee', 'c2227ff1-1c04-4a96-aa16-2b8168460208'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.073s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:03 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:03 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Deleted volume successfully. Sep 10 13:30:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d2014ff-2b26-4171-a347-8b22e56154ad tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-e4b3bb05-0e17-4985-8bf0-d0322d80e674-delete_volume" released by "delete_volume" :: held 4.297s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-9fc21100-869f-4a8c-974b-396d292aae80-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-9fc21100-869f-4a8c-974b-396d292aae80-delete_volume" acquired by "delete_volume" :: waited 0.370s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-c2bc308d-5cda-45c7-a2ee-e7e28ee4b0b3 req-cf57a8c2-1c2d-4754-82a3-5c2c0f6ad11a tempest-TaggedAttachmentsTest-1162609647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "cinder-quobyte-9fc21100-869f-4a8c-974b-396d292aae80" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-c2bc308d-5cda-45c7-a2ee-e7e28ee4b0b3 req-cf57a8c2-1c2d-4754-82a3-5c2c0f6ad11a tempest-TaggedAttachmentsTest-1162609647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:04 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-c2bc308d-5cda-45c7-a2ee-e7e28ee4b0b3 req-cf57a8c2-1c2d-4754-82a3-5c2c0f6ad11a tempest-TaggedAttachmentsTest-1162609647 None] Terminate volume connection completed successfully. Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-c2bc308d-5cda-45c7-a2ee-e7e28ee4b0b3 req-cf57a8c2-1c2d-4754-82a3-5c2c0f6ad11a tempest-TaggedAttachmentsTest-1162609647 None] Deleting attachment 763cd3f2-4cf4-4028-830a-3999cf6d34c6. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-9fc21100-869f-4a8c-974b-396d292aae80" acquired by "delete_volume" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64665e41-b5c3-4d6a-ae1e-076a0de2059c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80" returned: 0 in 0.397s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9fc21100-869f-4a8c-974b-396d292aae80" returned: 0 in 0.165s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-quobyte-9fc21100-869f-4a8c-974b-396d292aae80" released by "delete_volume" :: held 0.734s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Created reservations ['3fb8e42a-69aa-4929-aedd-af39dff1b49f', '536a082f-0f71-457e-9f1b-f88139bd1813', 'fa93c892-eb1f-463f-a2a8-069c6e5b89d1', 'f994a766-2341-4800-a142-d5c0e79d3270'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.108s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:05 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Deleted volume successfully. Sep 10 13:30:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-99c6e7c1-ff5a-45a6-8d3d-e30ada50e32e tempest-VolumesDeleteCascade-1891016450 None] Lock "cinder-9fc21100-869f-4a8c-974b-396d292aae80-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.184s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:12 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Flow 'volume_create_manager' (edadcadc-89ad-496c-af73-b0d361d325c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb7c9d3-6eb9-49e8-96e5-6dda9e20cbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb7c9d3-6eb9-49e8-96e5-6dda9e20cbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1571254960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d04257-b458-4661-97b9-44b135ddb249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601760d5483342c38e3065d8f62b53aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:12Z,use_quota=True,user_id='5d27df97f58f4d309001a572f93e59e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94704108-02d2-4e87-ace0-aa7c44dad9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94704108-02d2-4e87-ace0-aa7c44dad9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b0d54a-0f08-4959-acd8-d474758df367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b0d54a-0f08-4959-acd8-d474758df367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d04257-b458-4661-97b9-44b135ddb249', 'volume_name': 'volume-45d04257-b458-4661-97b9-44b135ddb249', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f961743-4d50-4c8d-ba7b-ab5921fe4f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f961743-4d50-4c8d-ba7b-ab5921fe4f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0e15d1-86c7-4e3a-84cb-110ad765d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:12 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Volume 45d04257-b458-4661-97b9-44b135ddb249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d04257-b458-4661-97b9-44b135ddb249', 'volume_size': 1} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1571254960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d04257-b458-4661-97b9-44b135ddb249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601760d5483342c38e3065d8f62b53aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:12Z,use_quota=True,user_id='5d27df97f58f4d309001a572f93e59e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Creating volume 45d04257-b458-4661-97b9-44b135ddb249 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:30:12 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:30:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:13 devstack quobyte-client[83260]: System call of process 89467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:30:13 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=46, name=volume-45d04257-b458-4661-97b9-44b135ddb249, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:30:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249 1073741824" returned: 0 in 0.510s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] <== create_volume: return (685ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:30:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0e15d1-86c7-4e3a-84cb-110ad765d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d04257-b458-4661-97b9-44b135ddb249', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a66ab1-3278-414e-a571-32ba2e6fc388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:14 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Volume volume-45d04257-b458-4661-97b9-44b135ddb249 (45d04257-b458-4661-97b9-44b135ddb249): created successfully Sep 10 13:30:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a66ab1-3278-414e-a571-32ba2e6fc388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Flow 'volume_create_manager' (edadcadc-89ad-496c-af73-b0d361d325c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3d76c6ae-fd7e-4a3a-a2a1-bd9b23e620ce tempest-VolumesMetadataTest-1198062058 None] Created volume successfully. Sep 10 13:30:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Acquiring lock "cinder-45d04257-b458-4661-97b9-44b135ddb249-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Lock "cinder-45d04257-b458-4661-97b9-44b135ddb249-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:16 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Acquiring lock "cinder-quobyte-45d04257-b458-4661-97b9-44b135ddb249" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Lock "cinder-quobyte-45d04257-b458-4661-97b9-44b135ddb249" acquired by "delete_volume" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb889c-3aa1-46c8-a799-7f3f9da396e5]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249" returned: 0 in 0.525s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-45d04257-b458-4661-97b9-44b135ddb249" returned: 0 in 0.098s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Lock "cinder-quobyte-45d04257-b458-4661-97b9-44b135ddb249" released by "delete_volume" :: held 0.808s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Created reservations ['5bc6d0e5-526c-466d-96b2-dff2104d520b', '44c06186-1fc6-43d1-ba50-15d2a132a671', '3f84ce45-71e4-4b62-87de-9f40718d82ea', '8e9970e0-749a-4617-8e59-108a54ba338e'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.115s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:17 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:17 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Deleted volume successfully. Sep 10 13:30:18 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4cfbecf9-7d16-4334-9f8d-2645693d48d0 tempest-VolumesMetadataTest-1198062058 None] Lock "cinder-45d04257-b458-4661-97b9-44b135ddb249-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Flow 'volume_create_manager' (af63f5ba-ff51-424e-86f8-f813afeedc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8751ba-382d-4a8e-b9d3-f8edb86db44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8751ba-382d-4a8e-b9d3-f8edb86db44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1221796246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4563c921-b164-4f39-964d-a92f6503f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3e07cb828f44ce9ac0555070de4b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:24Z,use_quota=True,user_id='833b80e2604346dbafc9878477cd84ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841f1a8-b784-4474-b093-3bcc36b5386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841f1a8-b784-4474-b093-3bcc36b5386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e233445a-53a1-42b6-9e92-172d6fc4a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e233445a-53a1-42b6-9e92-172d6fc4a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4563c921-b164-4f39-964d-a92f6503f501', 'volume_name': 'volume-4563c921-b164-4f39-964d-a92f6503f501', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0405413d-b87b-4b8c-90e9-2256ceb36bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0405413d-b87b-4b8c-90e9-2256ceb36bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e6cab2-25f4-4657-9e3e-2d12e39bd54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:24 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Volume 4563c921-b164-4f39-964d-a92f6503f501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4563c921-b164-4f39-964d-a92f6503f501', 'volume_size': 1} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1221796246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4563c921-b164-4f39-964d-a92f6503f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3e07cb828f44ce9ac0555070de4b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:24Z,use_quota=True,user_id='833b80e2604346dbafc9878477cd84ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Creating volume 4563c921-b164-4f39-964d-a92f6503f501 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:30:24 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:30:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:24 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=47, name=volume-4563c921-b164-4f39-964d-a92f6503f501, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501 1073741824" returned: 0 in 0.396s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501" returned: 0 in 0.125s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] <== create_volume: return (598ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.611s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e6cab2-25f4-4657-9e3e-2d12e39bd54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4563c921-b164-4f39-964d-a92f6503f501', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd55791-4263-4290-a1d3-8fc2f71fbe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:25 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Volume volume-4563c921-b164-4f39-964d-a92f6503f501 (4563c921-b164-4f39-964d-a92f6503f501): created successfully Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd55791-4263-4290-a1d3-8fc2f71fbe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Flow 'volume_create_manager' (af63f5ba-ff51-424e-86f8-f813afeedc20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:25 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8489f2a6-40c3-4834-a2ea-091ca0cedb5c tempest-VolumesTransfersV355Test-1108980298 None] Created volume successfully. Sep 10 13:30:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0a081d83-bd68-4ef6-bd2f-62d08b8b7595 tempest-VolumesTransfersV355Test-553979979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0a081d83-bd68-4ef6-bd2f-62d08b8b7595 tempest-VolumesTransfersV355Test-553979979 None] Transfer volume completed successfully. Sep 10 13:30:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Acquiring lock "cinder-4563c921-b164-4f39-964d-a92f6503f501-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-4563c921-b164-4f39-964d-a92f6503f501-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:29 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Acquiring lock "cinder-quobyte-4563c921-b164-4f39-964d-a92f6503f501" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-quobyte-4563c921-b164-4f39-964d-a92f6503f501" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:29 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee332c-8088-4f4b-81b1-c6349e010dd2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501" returned: 0 in 0.762s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4563c921-b164-4f39-964d-a92f6503f501" returned: 0 in 0.118s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-quobyte-4563c921-b164-4f39-964d-a92f6503f501" released by "delete_volume" :: held 1.172s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Created reservations ['6cb31e00-1a3d-40c3-878e-e8a88790718b', '569b84d9-24a8-4bac-b2a3-41df62f2967c', '171142b3-7da4-444f-a136-c45f4c77809f', 'd0061b1b-e277-449c-acb1-697984539ce3'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.402s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:32 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Deleted volume successfully. Sep 10 13:30:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ca07a455-016d-48b9-897d-74bf94c4c091 tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-4563c921-b164-4f39-964d-a92f6503f501-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Flow 'volume_create_manager' (df5a9541-6cec-4be3-a530-fbf39d9b85b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a66f65-60c1-4b92-b0fa-c664c0e79778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a66f65-60c1-4b92-b0fa-c664c0e79778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1080716812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9478626-a0ac-4d37-b05d-49214416c442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3e07cb828f44ce9ac0555070de4b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:33Z,use_quota=True,user_id='833b80e2604346dbafc9878477cd84ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43896543-6179-427e-ad75-456988913521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43896543-6179-427e-ad75-456988913521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ea47f0-110f-4d6f-9a00-9d67c52411de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ea47f0-110f-4d6f-9a00-9d67c52411de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9478626-a0ac-4d37-b05d-49214416c442', 'volume_name': 'volume-a9478626-a0ac-4d37-b05d-49214416c442', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95ed960-c7ef-4c19-9e77-2bd509e96da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95ed960-c7ef-4c19-9e77-2bd509e96da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1dffec-72a4-499c-af26-f9add97bfcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:33 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Volume a9478626-a0ac-4d37-b05d-49214416c442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9478626-a0ac-4d37-b05d-49214416c442', 'volume_size': 1} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1080716812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9478626-a0ac-4d37-b05d-49214416c442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3e07cb828f44ce9ac0555070de4b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:33Z,use_quota=True,user_id='833b80e2604346dbafc9878477cd84ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Creating volume a9478626-a0ac-4d37-b05d-49214416c442 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:30:33 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:30:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:34 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=48, name=volume-a9478626-a0ac-4d37-b05d-49214416c442, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:30:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442 1073741824" returned: 0 in 0.466s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442" returned: 0 in 0.142s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] <== create_volume: return (711ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:30:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1dffec-72a4-499c-af26-f9add97bfcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9478626-a0ac-4d37-b05d-49214416c442', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8c3d07-9150-4aa1-815d-0f3654798c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:35 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Volume volume-a9478626-a0ac-4d37-b05d-49214416c442 (a9478626-a0ac-4d37-b05d-49214416c442): created successfully Sep 10 13:30:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8c3d07-9150-4aa1-815d-0f3654798c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Flow 'volume_create_manager' (df5a9541-6cec-4be3-a530-fbf39d9b85b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:35 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9c12092c-7c61-48d5-b1e6-1216d0c4c6bb tempest-VolumesTransfersV355Test-1108980298 None] Created volume successfully. Sep 10 13:30:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Acquiring lock "cinder-a9478626-a0ac-4d37-b05d-49214416c442-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-a9478626-a0ac-4d37-b05d-49214416c442-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Acquiring lock "cinder-quobyte-a9478626-a0ac-4d37-b05d-49214416c442" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-quobyte-a9478626-a0ac-4d37-b05d-49214416c442" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:36 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba6ea4-3bc9-4f3f-baf6-bed72ba304b0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442" returned: 0 in 0.552s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a9478626-a0ac-4d37-b05d-49214416c442" returned: 0 in 0.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-quobyte-a9478626-a0ac-4d37-b05d-49214416c442" released by "delete_volume" :: held 0.942s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Created reservations ['3e600200-8130-4749-ac4b-7847463009c6', '0429d97e-43f6-47b5-b4d9-92e006b38640', '15f57188-6424-4794-8ef9-211a6d214590', '6f1518b4-d689-4fa7-a1d6-7121dbd125f2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.102s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:38 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:39 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Deleted volume successfully. Sep 10 13:30:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-057e5628-9990-4b08-aeea-fe4c1a626eae tempest-VolumesTransfersV355Test-11346013 None] Lock "cinder-a9478626-a0ac-4d37-b05d-49214416c442-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "cinder-f3727039-e20a-489e-ab08-86951dd662a3-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-f3727039-e20a-489e-ab08-86951dd662a3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:45 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "cinder-quobyte-f3727039-e20a-489e-ab08-86951dd662a3" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-quobyte-f3727039-e20a-489e-ab08-86951dd662a3" acquired by "delete_volume" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d65efe-5f75-4d08-bb70-25ac52c7ea26]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3" returned: 0 in 0.559s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f3727039-e20a-489e-ab08-86951dd662a3" returned: 0 in 0.109s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-quobyte-f3727039-e20a-489e-ab08-86951dd662a3" released by "delete_volume" :: held 0.863s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:46 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Created reservations ['40370424-a08c-4197-b182-bd8b9c5d17f9', '77d35162-9d6c-4f5d-a791-305f6ad2718f', 'd482b884-cc3a-4b12-9992-abe1aca1beaa', '01741ea7-6088-4bde-a274-469a0f5eea98'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.108s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:47 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Deleted volume successfully. Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-75ad208b-bf79-4afe-85ef-c37dccf70d2a tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-f3727039-e20a-489e-ab08-86951dd662a3-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "cinder-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:48 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "cinder-quobyte-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-quobyte-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca" acquired by "delete_volume" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:48 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6323d169-73a0-4668-b14d-df6b2e03e1b2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca" returned: 0 in 0.516s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca" returned: 0 in 0.132s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-quobyte-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca" released by "delete_volume" :: held 0.850s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Created reservations ['5b7990c3-9a95-426d-8e16-4f21807e71da', '8f0de511-f833-4e09-a18e-93de2dce52ff', 'cafd0077-27bf-4f57-ab34-6c5e921bc5fd', '36228a51-141b-4b13-a898-8cef94941ab9'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.156s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:50 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Deleted volume successfully. Sep 10 13:30:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7f62eb04-eac6-4964-af31-34bd13043677 tempest-AttachVolumeShelveTestJSON-1870643907 None] Lock "cinder-ed6c8ef7-aa5d-4495-a3bd-d63a190bd5ca-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:52 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Acquiring lock "cinder-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:52 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Lock "cinder-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:53 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Acquiring lock "cinder-quobyte-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:30:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Lock "cinder-quobyte-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:30:53 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef30f94-2f86-4343-ad9f-bff57f3a456c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:30:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7" returned: 0 in 0.510s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7" returned: 0 in 0.193s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Lock "cinder-quobyte-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7" released by "delete_volume" :: held 1.393s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:54 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:54 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:30:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Flow 'volume_create_manager' (1480b78f-6c5a-4ab0-99ce-a24df0f1fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e46a00e-6be2-443f-afa6-06af4b60f64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e46a00e-6be2-443f-afa6-06af4b60f64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054446477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bd1273-d277-4388-8912-ac56ced8cf4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85aaa1c96704d3b98ad8cfe912871d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:54Z,use_quota=True,user_id='97acaf0d557542678b037f35d17bbb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2444bb53-bc94-4cea-9a62-5a4c7919118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2444bb53-bc94-4cea-9a62-5a4c7919118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a210c2e-5c9d-44f5-abf2-a80bc6e3f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a210c2e-5c9d-44f5-abf2-a80bc6e3f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1bd1273-d277-4388-8912-ac56ced8cf4a', 'volume_name': 'volume-d1bd1273-d277-4388-8912-ac56ced8cf4a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c935f0f-8611-4080-8e15-fc9d3dd80956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c935f0f-8611-4080-8e15-fc9d3dd80956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbee5f2-6d99-4c78-a842-e70da8aef0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:55 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Volume d1bd1273-d277-4388-8912-ac56ced8cf4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1bd1273-d277-4388-8912-ac56ced8cf4a', 'volume_size': 1} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054446477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bd1273-d277-4388-8912-ac56ced8cf4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85aaa1c96704d3b98ad8cfe912871d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:30:54Z,use_quota=True,user_id='97acaf0d557542678b037f35d17bbb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Creating volume d1bd1273-d277-4388-8912-ac56ced8cf4a {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:30:55 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:55 devstack quobyte-client[83260]: System call of process 89645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:30:55 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=49, name=volume-d1bd1273-d277-4388-8912-ac56ced8cf4a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Created reservations ['955ac93c-8d62-42ec-861c-82f76e9b9228', '2b0f46e0-8e95-4289-9a93-cb112b7ced64', '7f63629f-6304-4a29-902a-840b715b1cd5', 'c25f94f7-c6b9-4090-aa04-fa3503543431'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a 1073741824" returned: 0 in 0.531s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=77,cinder:DELETE=7,cinder:SELECT=46,cinder:INSERT=19 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=58,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a" returned: 0 in 0.660s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] <== create_volume: return (1230ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.402s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbee5f2-6d99-4c78-a842-e70da8aef0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1bd1273-d277-4388-8912-ac56ced8cf4a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a161286-92dc-430f-8d67-08bba2dda687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:30:56 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Deleted volume successfully. Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fc3d2ef4-8086-417b-84fd-3293ccd00333 tempest-TaggedAttachmentsTest-1162609647 None] Lock "cinder-5730bab1-6cd4-4d6f-aa5d-8a5aa0f7aba7-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:30:56 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Volume volume-d1bd1273-d277-4388-8912-ac56ced8cf4a (d1bd1273-d277-4388-8912-ac56ced8cf4a): created successfully Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a161286-92dc-430f-8d67-08bba2dda687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:30:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Flow 'volume_create_manager' (1480b78f-6c5a-4ab0-99ce-a24df0f1fc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:30:56 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2a244e28-0eb9-4461-be54-cc057a471fbf tempest-VolumesTransfersV357Test-555102802 None] Created volume successfully. Sep 10 13:30:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-17f49344-789c-46fd-9b07-aee9d13863ee tempest-VolumesTransfersV357Test-1240586933 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:30:59 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-17f49344-789c-46fd-9b07-aee9d13863ee tempest-VolumesTransfersV357Test-1240586933 None] Transfer volume completed successfully. Sep 10 13:31:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Acquiring lock "cinder-d1bd1273-d277-4388-8912-ac56ced8cf4a-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-d1bd1273-d277-4388-8912-ac56ced8cf4a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:01 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Acquiring lock "cinder-quobyte-d1bd1273-d277-4388-8912-ac56ced8cf4a" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-quobyte-d1bd1273-d277-4388-8912-ac56ced8cf4a" acquired by "delete_volume" :: waited 0.042s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:01 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a9872-364c-4251-a834-92ec7c716ac0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:31:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a" returned: 0 in 0.520s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d1bd1273-d277-4388-8912-ac56ced8cf4a" returned: 0 in 0.119s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-quobyte-d1bd1273-d277-4388-8912-ac56ced8cf4a" released by "delete_volume" :: held 0.865s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:31:02 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Created reservations ['e3cc9470-df75-40e5-b76c-3c939af1a18d', '96efd639-f2b4-495d-9255-7949299640f2', '108ab8a9-8131-4037-87e6-ba886f81a7ed', 'd150ee32-7035-45c2-807e-8637e64dc633'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.149s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:31:03 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Deleted volume successfully. Sep 10 13:31:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-307c2308-5474-461d-89b6-d7ada9d2cf60 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-d1bd1273-d277-4388-8912-ac56ced8cf4a-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:31:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Flow 'volume_create_manager' (4d28610a-cb0a-443c-9200-c8d49c43742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6afc07-0871-4100-bf71-df607b2cea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6afc07-0871-4100-bf71-df607b2cea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1961995027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85aaa1c96704d3b98ad8cfe912871d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:05Z,use_quota=True,user_id='97acaf0d557542678b037f35d17bbb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0270071-4c03-4ceb-8c0f-ac96e3252710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0270071-4c03-4ceb-8c0f-ac96e3252710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e67b97-d820-4d3b-9359-9bb58abcb8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e67b97-d820-4d3b-9359-9bb58abcb8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf', 'volume_name': 'volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f76908-1735-4077-a89b-7d00c4a230cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f76908-1735-4077-a89b-7d00c4a230cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f03ac47-b498-4cb1-9ef5-af4b52e5eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:05 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Volume fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf', 'volume_size': 1} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1961995027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d85aaa1c96704d3b98ad8cfe912871d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:05Z,use_quota=True,user_id='97acaf0d557542678b037f35d17bbb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Creating volume fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:31:05 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:05 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=50, name=volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:31:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Flow 'volume_create_manager' (ee822bd3-e70b-46cc-94db-f2d49b8a95f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bf9e18-412c-4fb3-bc14-0595b122bad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bf9e18-412c-4fb3-bc14-0595b122bad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1449979536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f26b5a-920e-4035-9311-aaaba99278ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f92afea228c64b9a9ebebb60ae84add0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:05Z,use_quota=True,user_id='3a4dce17e152417892e231af5285f900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7605d998-051d-47ab-8d2b-f9347f102124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7605d998-051d-47ab-8d2b-f9347f102124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f57d398-0175-4f6b-a711-da2957d882b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f57d398-0175-4f6b-a711-da2957d882b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f26b5a-920e-4035-9311-aaaba99278ab', 'volume_name': 'volume-e6f26b5a-920e-4035-9311-aaaba99278ab', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d2a265-3319-4028-89a3-9dce36321f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d2a265-3319-4028-89a3-9dce36321f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b74f93-ed04-48fc-9d43-aa70a0b73d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Volume e6f26b5a-920e-4035-9311-aaaba99278ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f26b5a-920e-4035-9311-aaaba99278ab', 'volume_size': 1} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf 1073741824" returned: 0 in 0.661s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] <== create_volume: return (798ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1449979536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f26b5a-920e-4035-9311-aaaba99278ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f92afea228c64b9a9ebebb60ae84add0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:05Z,use_quota=True,user_id='3a4dce17e152417892e231af5285f900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Creating volume e6f26b5a-920e-4035-9311-aaaba99278ab {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:31:06 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:06 devstack quobyte-client[83260]: System call of process 89664 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:31:06 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=51, name=volume-e6f26b5a-920e-4035-9311-aaaba99278ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f03ac47-b498-4cb1-9ef5-af4b52e5eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccd21ec-1f2e-4f7b-8418-f0776fb8d7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Volume volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf (fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf): created successfully Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccd21ec-1f2e-4f7b-8418-f0776fb8d7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Flow 'volume_create_manager' (4d28610a-cb0a-443c-9200-c8d49c43742f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab 1073741824" returned: 0 in 0.522s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c7fb6001-5b46-49b2-b899-c57a1813d021 tempest-VolumesTransfersV357Test-555102802 None] Created volume successfully. Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab" returned: 0 in 0.342s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] <== create_volume: return (895ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b74f93-ed04-48fc-9d43-aa70a0b73d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f26b5a-920e-4035-9311-aaaba99278ab', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c98e0f3-bb69-446b-a859-07dd43c045b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:07 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Volume volume-e6f26b5a-920e-4035-9311-aaaba99278ab (e6f26b5a-920e-4035-9311-aaaba99278ab): created successfully Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c98e0f3-bb69-446b-a859-07dd43c045b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Flow 'volume_create_manager' (ee822bd3-e70b-46cc-94db-f2d49b8a95f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-7c47883b-83b4-4e1c-9e8c-271fc1030076 req-b2ef1c69-416a-4414-bd68-33ef54020c76 tempest-VolumesGetTestJSON-1873040535 None] Created volume successfully. Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Acquiring lock "cinder-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:08 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Acquiring lock "cinder-quobyte-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-quobyte-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf" acquired by "delete_volume" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:08 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[76962fd1-07d6-4af9-bb65-d7b2f8620dcc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:31:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:08 devstack quobyte-client[83260]: System call of process 89669 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:31:08 devstack quobyte-client[83260]: System call of process 89669 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:31:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Acquiring lock "cinder-e6f26b5a-920e-4035-9311-aaaba99278ab-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf" returned: 0 in 1.043s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf" returned: 0 in 0.258s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Lock "cinder-e6f26b5a-920e-4035-9311-aaaba99278ab-delete_volume" acquired by "delete_volume" :: waited 0.451s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-quobyte-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf" released by "delete_volume" :: held 1.640s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:31:09 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Acquiring lock "cinder-quobyte-e6f26b5a-920e-4035-9311-aaaba99278ab" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Lock "cinder-quobyte-e6f26b5a-920e-4035-9311-aaaba99278ab" acquired by "delete_volume" :: waited 0.090s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Created reservations ['94a1b4fc-a378-4fac-bc62-17f7b16a4a39', '88d727fa-ab1a-40de-9a27-35f0da787e85', '260e15c0-643a-482c-a3dc-12a5fdec7015', 'd32137f9-956c-4dd9-bd12-e3bffa67c2e8'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0d71d0-f8f1-4abb-952e-703886f9a329]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:10 devstack quobyte-client[83260]: System call of process 89674 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:31:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab" returned: 0 in 0.935s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.894s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:31:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-e6f26b5a-920e-4035-9311-aaaba99278ab" returned: 0 in 0.663s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Lock "cinder-quobyte-e6f26b5a-920e-4035-9311-aaaba99278ab" released by "delete_volume" :: held 1.786s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:31:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:12 devstack cinder-volume[83206]: DEBUG cinder.quota [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Created reservations ['c1574866-5ad7-4609-9b3c-6ddc7c08cfdb', '62eaa0d3-c159-4584-91e1-8d6387e08275', 'e06f75bf-275b-4552-ae5d-42138cb52eff', '5e266edd-e83a-4310-aeb6-823bcc0caa35'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.646s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:31:13 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Deleted volume successfully. Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3cbdbf59-a3a1-43e6-92b6-e0983b5f9127 tempest-VolumesTransfersV357Test-1417685370 None] Lock "cinder-fff303a4-8dfe-4f6e-aced-bc5aca1f4ebf-delete_volume" released by "delete_volume" :: held 5.314s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.123s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:13 devstack cinder-volume[83206]: DEBUG cinder.manager [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:31:13 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Deleted volume successfully. Sep 10 13:31:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-f46d3bd1-7c65-417b-9cd8-e7799229a3b9 req-4c6a8f0a-d732-4fbf-8f7f-25e443e43a45 tempest-VolumesGetTestJSON-1873040535 None] Lock "cinder-e6f26b5a-920e-4035-9311-aaaba99278ab-delete_volume" released by "delete_volume" :: held 4.509s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:31:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-87251a4d-c129-45de-8771-4aa48ef147a9 tempest-BackendsCapabilitiesAdminTestsJSON-406703326 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83206) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 13:31:23 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=31,cinder:SELECT=16,cinder:INSERT=10,cinder:DELETE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:31:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1f0f4dd1-6b1d-417f-a71b-23cd95c1c9f8 tempest-BackendsCapabilitiesAdminTestsJSON-406703326 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83206) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 13:31:23 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=34,cinder:DELETE=4,cinder:SELECT=19,cinder:INSERT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:31:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-e92d2928-3a4a-4a6f-8309-9dc1f9cf680d tempest-GroupSnapshotsV319Test-1678379095 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e92d2928-3a4a-4a6f-8309-9dc1f9cf680d tempest-GroupSnapshotsV319Test-1678379095 None] Group tempest-GroupSnapshotsV319Test-Group-116634764: creating Sep 10 13:31:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e92d2928-3a4a-4a6f-8309-9dc1f9cf680d tempest-GroupSnapshotsV319Test-1678379095 None] Group tempest-GroupSnapshotsV319Test-Group-116634764: created successfully Sep 10 13:31:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e92d2928-3a4a-4a6f-8309-9dc1f9cf680d tempest-GroupSnapshotsV319Test-1678379095 None] Create group completed successfully. Sep 10 13:31:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Flow 'volume_create_manager' (d505bb9b-989f-424b-aed8-25b697b9c666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3add3f-aa37-4f0e-abd3-dab21b9456f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3add3f-aa37-4f0e-abd3-dab21b9456f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-783352777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e357c8-8d69-4095-b583-a9c82be7bd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d330c20122a64012bd772b616f9f63dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:47Z,use_quota=True,user_id='456ceecfe9f8423e8f600a6c75a3e236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0855cc5-e515-4278-9aab-44c1026f8c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0855cc5-e515-4278-9aab-44c1026f8c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becdb560-c3ad-4290-9499-be1238eef4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becdb560-c3ad-4290-9499-be1238eef4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e357c8-8d69-4095-b583-a9c82be7bd35', 'volume_name': 'volume-73e357c8-8d69-4095-b583-a9c82be7bd35', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672fedd8-5a0f-4ee4-ab9d-cabd8c4a5452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672fedd8-5a0f-4ee4-ab9d-cabd8c4a5452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b18576c-b078-4036-9672-fbe8a59e7bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:47 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Volume 73e357c8-8d69-4095-b583-a9c82be7bd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e357c8-8d69-4095-b583-a9c82be7bd35', 'volume_size': 1} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-783352777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e357c8-8d69-4095-b583-a9c82be7bd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d330c20122a64012bd772b616f9f63dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:47Z,use_quota=True,user_id='456ceecfe9f8423e8f600a6c75a3e236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Creating volume 73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:31:47 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:47 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=52, name=volume-73e357c8-8d69-4095-b583-a9c82be7bd35, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 1073741824" returned: 0 in 0.490s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 0.147s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b18576c-b078-4036-9672-fbe8a59e7bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e357c8-8d69-4095-b583-a9c82be7bd35', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa6bb7e-cd0b-4760-a00e-2def2a9f582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Volume volume-73e357c8-8d69-4095-b583-a9c82be7bd35 (73e357c8-8d69-4095-b583-a9c82be7bd35): created successfully Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa6bb7e-cd0b-4760-a00e-2def2a9f582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Flow 'volume_create_manager' (d505bb9b-989f-424b-aed8-25b697b9c666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:48 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Flow 'volume_create_manager' (4aa499d5-5713-4eec-9f02-7c6409d148b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decf51a1-afc7-47dc-85c2-f54ce69aec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decf51a1-afc7-47dc-85c2-f54ce69aec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289090263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c590ca0c-cd7c-47c4-aa96-c979af2ebcdc,host='devstack@QuobyteHD#QuobyteHD',id=34bf05ae-3dfe-4e60-a5ad-a6a8167920fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cde62a1c8d47ffb927a468efd661fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:48Z,use_quota=True,user_id='c80ed1d722654c5ea5cd0f5a61d73b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc11153e-5657-4dad-aa40-d750db917506),volume_type_id=bc11153e-5657-4dad-aa40-d750db917506)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d7ef0-bb5c-4446-8544-065221b81f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d7ef0-bb5c-4446-8544-065221b81f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb822a80-d27a-4154-83b6-3dcc0efdd7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb822a80-d27a-4154-83b6-3dcc0efdd7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34bf05ae-3dfe-4e60-a5ad-a6a8167920fe', 'volume_name': 'volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45168cd5-25bd-4252-9ece-731ac25506b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45168cd5-25bd-4252-9ece-731ac25506b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb8649-8e33-4408-9dee-c7aa8ec1e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Volume 34bf05ae-3dfe-4e60-a5ad-a6a8167920fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe', 'volume_size': 1} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c590ca0c-cd7c-47c4-aa96-c979af2ebcdc,created_at=2025-09-10T11:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289090263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c590ca0c-cd7c-47c4-aa96-c979af2ebcdc,host='devstack@QuobyteHD#QuobyteHD',id=34bf05ae-3dfe-4e60-a5ad-a6a8167920fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cde62a1c8d47ffb927a468efd661fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:48Z,use_quota=True,user_id='c80ed1d722654c5ea5cd0f5a61d73b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc11153e-5657-4dad-aa40-d750db917506),volume_type_id=bc11153e-5657-4dad-aa40-d750db917506)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Creating volume 34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:31:48 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:31:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:48 devstack quobyte-client[83260]: System call of process 89733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:31:48 devstack quobyte-client[83260]: System call of process 89733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:31:48 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=53, name=volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:31:49 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-46146f4d-c40f-47c2-a01a-fd3290c5c550 tempest-VolumesActionsTest-123140361 None] Created volume successfully. Sep 10 13:31:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe 1073741824" returned: 0 in 0.554s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" returned: 0 in 0.252s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] <== create_volume: return (860ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:31:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb8649-8e33-4408-9dee-c7aa8ec1e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49023725-56cf-4b9d-9bdb-bd3790d8d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:31:50 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Volume volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe (34bf05ae-3dfe-4e60-a5ad-a6a8167920fe): created successfully Sep 10 13:31:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49023725-56cf-4b9d-9bdb-bd3790d8d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:31:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Flow 'volume_create_manager' (4aa499d5-5713-4eec-9f02-7c6409d148b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:31:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-413594ae-94f2-400e-a709-773ba507d39f tempest-GroupSnapshotsV319Test-1678379095 None] Created volume successfully. Sep 10 13:31:51 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] GroupSnapshot 36e2e6d9-ef5f-4951-954f-af479d051e9e: creating. Sep 10 13:31:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Group snapshot 36e2e6d9-ef5f-4951-954f-af479d051e9e: creating. {{(pid=83206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 13:31:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:31:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:31:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Creating offline snapshot a4e33a3c-0f70-435e-a46e-db18a476f358 of volume 34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:31:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecb9353-1a5c-4f0f-9754-bd1a0015e53d]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:31:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" returned: 0 in 0.893s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:52 devstack quobyte-client[83260]: System call of process 89740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:31:52 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=54, name=volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:31:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 1G" returned: 0 in 0.372s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): qemu-img rebase -u -b volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "qemu-img rebase -u -b volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358" returned: 0 in 0.295s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358" returned: 0 in 0.318s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358" returned: 0 in 0.115s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.info" returned: 0 in 0.171s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:31:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.info" returned: 0 in 0.171s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:31:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5ad3463c-418e-4485-a0ef-d4dd9f5299a1 tempest-GroupSnapshotsV319Test-1678379095 None] group_snapshot 36e2e6d9-ef5f-4951-954f-af479d051e9e: created successfully Sep 10 13:31:56 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] group_snapshot 36e2e6d9-ef5f-4951-954f-af479d051e9e: deleting Sep 10 13:31:56 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] group_snapshot 36e2e6d9-ef5f-4951-954f-af479d051e9e: deleting {{(pid=83206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Acquiring lock "cinder-quobyte-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Lock "cinder-quobyte-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" acquired by "delete_snapshot" :: waited 0.079s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Acquiring lock "cinder-quobyte-a4e33a3c-0f70-435e-a46e-db18a476f358" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Lock "cinder-quobyte-a4e33a3c-0f70-435e-a46e-db18a476f358" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Deleting offline snapshot a4e33a3c-0f70-435e-a46e-db18a476f358 of volume 34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] snapshot_file for this snap is: volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df6774-744b-4652-92ff-8fd5526849c9]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:31:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358" returned: 0 in 0.645s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:31:57 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c985894-8e1f-495c-8554-e422411405f7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:31:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" returned: 0 in 0.724s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358" returned: 0 in 0.359s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:31:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe.a4e33a3c-0f70-435e-a46e-db18a476f358" returned: 0 in 0.262s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:31:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Lock "cinder-quobyte-a4e33a3c-0f70-435e-a46e-db18a476f358" released by "_delete_snapshot" :: held 2.558s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:31:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Lock "cinder-quobyte-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" released by "delete_snapshot" :: held 2.591s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:00 devstack cinder-volume[83206]: WARNING cinder.quota [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-686970030 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-686970030, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:32:00 devstack cinder-volume[83206]: WARNING cinder.quota [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-686970030 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-686970030, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:32:00 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] Created reservations ['703256c5-b81f-48fe-b124-5df73aba4391', 'af681ad0-0c4c-4ebe-b202-92d16d06f26a', '9189871d-bf63-401f-bbbb-564616467138', '4c1082ec-7d72-452d-85f8-099d64a7f5d0'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:32:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-34db2ba4-b397-4c9b-b06c-cca12e40acec tempest-GroupSnapshotsV319Test-1678379095 None] group_snapshot 36e2e6d9-ef5f-4951-954f-af479d051e9e: deleted successfully Sep 10 13:32:01 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Acquiring lock "cinder-quobyte-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Lock "cinder-quobyte-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" acquired by "delete_volume" :: waited 0.073s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:02 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5252ee00-d8d3-4cc2-b70e-e010efa61555]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" returned: 0 in 1.778s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Flow 'volume_create_manager' (1749758a-d406-4b38-8e29-97d501d37873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4bf435-5d7f-42ae-ae87-927f52e23efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" returned: 0 in 0.753s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4bf435-5d7f-42ae-ae87-927f52e23efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-338591847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35f9579-8a87-4637-abb3-509e219ff708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16010be302147d69781676059855460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:03Z,use_quota=True,user_id='beff7b30ebf34434841285ca44f8ae7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93108518-0623-4963-a444-22b43532b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93108518-0623-4963-a444-22b43532b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca24819-5a04-4833-8c91-2a2de6f7b849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Lock "cinder-quobyte-34bf05ae-3dfe-4e60-a5ad-a6a8167920fe" released by "delete_volume" :: held 2.853s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Created reservations ['b6c1d231-00a5-417c-98ed-7d493b8f43dc'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca24819-5a04-4833-8c91-2a2de6f7b849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b35f9579-8a87-4637-abb3-509e219ff708', 'volume_name': 'volume-b35f9579-8a87-4637-abb3-509e219ff708', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcc8fe5-98de-4642-966e-d8b3db0b5153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcc8fe5-98de-4642-966e-d8b3db0b5153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9202404d-a17b-4280-aab3-1f2109689c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:05 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Volume b35f9579-8a87-4637-abb3-509e219ff708: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b35f9579-8a87-4637-abb3-509e219ff708', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Cloning b35f9579-8a87-4637-abb3-509e219ff708 from image 63abeada-c2a5-416e-b79d-1e59204999db at location (None, None). {{(pid=83206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 13:32:05 devstack cinder-volume[83206]: WARNING cinder.quota [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-686970030 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-686970030, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Created reservations ['4ef2d556-f424-4dc0-8d91-02c0a0af185c', 'ad114b42-aa2f-48f7-b395-c924dc42a6d2', 'd70b9287-2893-4072-82e2-4c143d471ce2', 'c18e7a75-e01b-44d0-b242-3f7293cb55d2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:06 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 13:32:06 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Image download 20.69 MB at 20.69 MB/s Sep 10 13:32:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.283s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:06 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:32:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-cb88ce57-15f1-4ef1-b081-860d0fef4932 tempest-GroupSnapshotsV319Test-1678379095 None] Delete group completed successfully. Sep 10 13:32:06 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3180799-2020-40f1-b7bb-92b210b62fe1]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:06 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD Sep 10 13:32:06 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:32:09 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Sep 10 13:32:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD" returned: 0 in 3.466s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:09 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db is fetched for user beff7b30ebf34434841285ca44f8ae7a. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ac0e8-0e79-4261-bccf-b86f35019fb2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:10 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD Sep 10 13:32:10 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.161s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:10 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:32:15 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD" returned: 0 in 5.340s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-338591847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35f9579-8a87-4637-abb3-509e219ff708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16010be302147d69781676059855460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:03Z,use_quota=True,user_id='beff7b30ebf34434841285ca44f8ae7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Creating volume b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:32:15 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:32:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:16 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=56, name=volume-b35f9579-8a87-4637-abb3-509e219ff708, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 1073741824" returned: 0 in 0.723s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 0 in 0.268s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] <== create_volume: return (1240ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:32:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:17 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Attempting download of 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume b35f9579-8a87-4637-abb3-509e219ff708. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 13:32:17 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[462399e0-efc9-4d3b-bf48-55de513b199a]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_22m7tlnq {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_22m7tlnq" returned: 0 in 0.885s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_22m7tlnq {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_22m7tlnq" returned: 1 in 0.772s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_22m7tlnq' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:32:19 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d47b1ea-e3b4-499b-9c8e-d0060289b52b]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:20 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] 63abeada-c2a5-416e-b79d-1e59204999db was qcow2, converting to raw {{(pid=83206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 13:32:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:21 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=56, name=volume-b35f9579-8a87-4637-abb3-509e219ff708, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:21 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Flow 'volume_create_manager' (7d2b830b-8a97-45f7-8d13-869e5891c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d2bb37-7bd1-47ac-b3f3-a9f78a71c7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d2bb37-7bd1-47ac-b3f3-a9f78a71c7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-211654342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154c745e-c961-4c0f-b96d-feca36680b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de54fab46b24c16b336f19493b64159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:20Z,use_quota=True,user_id='3930d806680c45ac87594a1cc5d59740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5598da41-eb7b-41c3-a6f9-21a30f6807c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5598da41-eb7b-41c3-a6f9-21a30f6807c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8e4283-91ec-41fa-8095-47e4bedaeaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8e4283-91ec-41fa-8095-47e4bedaeaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154c745e-c961-4c0f-b96d-feca36680b61', 'volume_name': 'volume-154c745e-c961-4c0f-b96d-feca36680b61', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e395066f-2f8c-4a98-bd0b-380a0b7463d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e395066f-2f8c-4a98-bd0b-380a0b7463d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af8ebea-2550-4111-b288-1a72cab8ecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:21 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Volume 154c745e-c961-4c0f-b96d-feca36680b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154c745e-c961-4c0f-b96d-feca36680b61', 'volume_size': 1} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-211654342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154c745e-c961-4c0f-b96d-feca36680b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de54fab46b24c16b336f19493b64159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:20Z,use_quota=True,user_id='3930d806680c45ac87594a1cc5d59740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Creating volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:32:21 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:32:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:22 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=57, name=volume-154c745e-c961-4c0f-b96d-feca36680b61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 1073741824" returned: 0 in 0.800s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-369a4d3c-2e41-4916-a857-1bf3506136ba tempest-VolumesActionsTest-123140361 None] Acquiring lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35" by "attach_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 0 in 2.346s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_nq0tdruddevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:32:23 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Converted 112.00 MB image at 47.59 MB/s Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61" returned: 0 in 0.469s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:23 devstack quobyte-client[83260]: System call of process 89902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] <== create_volume: return (1514ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 1G" returned: 0 in 0.371s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-369a4d3c-2e41-4916-a857-1bf3506136ba tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35" acquired by "attach_volume" :: waited 0.493s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af8ebea-2550-4111-b288-1a72cab8ecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154c745e-c961-4c0f-b96d-feca36680b61', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f504b1e-5924-4b32-8184-785245d5c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f27f1-8a99-4b4e-a1bc-3ebfb0c08fa2]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:24 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Volume volume-154c745e-c961-4c0f-b96d-feca36680b61 (154c745e-c961-4c0f-b96d-feca36680b61): created successfully Sep 10 13:32:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f504b1e-5924-4b32-8184-785245d5c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Flow 'volume_create_manager' (7d2b830b-8a97-45f7-8d13-869e5891c0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:24 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-378397bd-77d6-4784-8dda-e86024a64f16 tempest-SnapshotsActionsTest-287245114 None] Created volume successfully. Sep 10 13:32:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-369a4d3c-2e41-4916-a857-1bf3506136ba tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:24 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-369a4d3c-2e41-4916-a857-1bf3506136ba tempest-VolumesActionsTest-123140361 None] Attaching volume 73e357c8-8d69-4095-b583-a9c82be7bd35 to instance f8ea1efc-885a-4324-9ead-887cababd366 at mountpoint /dev/vdb on host None. Sep 10 13:32:24 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-369a4d3c-2e41-4916-a857-1bf3506136ba tempest-VolumesActionsTest-123140361 None] Attach volume completed successfully. Sep 10 13:32:24 devstack quobyte-client[83260]: System call of process 89905 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 0 in 0.730s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-369a4d3c-2e41-4916-a857-1bf3506136ba tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35" released by "attach_volume" :: held 1.103s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:25 devstack quobyte-client[83260]: System call of process 89907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 1 in 0.858s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Downloaded image 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume b35f9579-8a87-4637-abb3-509e219ff708 successfully. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db for user beff7b30ebf34434841285ca44f8ae7a is deleted. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Marking volume b35f9579-8a87-4637-abb3-509e219ff708 as bootable. {{(pid=83206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Copying metadata from image 63abeada-c2a5-416e-b79d-1e59204999db to b35f9579-8a87-4637-abb3-509e219ff708. {{(pid=83206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Creating volume glance metadata for volume b35f9579-8a87-4637-abb3-509e219ff708 backed by image 63abeada-c2a5-416e-b79d-1e59204999db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 13:32:25 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Creating offline snapshot 5ba104ae-7201-4b1b-9958-e06d76c50f26 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25034910-a522-4668-9ec7-8ca177260e28]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d383e91-7ee6-4caa-be78-3e7fa3630471 tempest-VolumesActionsTest-123140361 None] Acquiring lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-detach_volume" by "detach_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d383e91-7ee6-4caa-be78-3e7fa3630471 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-detach_volume" acquired by "detach_volume" :: waited 0.122s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-6d383e91-7ee6-4caa-be78-3e7fa3630471 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:26 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-6d383e91-7ee6-4caa-be78-3e7fa3630471 tempest-VolumesActionsTest-123140361 None] Detaching volume 73e357c8-8d69-4095-b583-a9c82be7bd35 from instance f8ea1efc-885a-4324-9ead-887cababd366. Sep 10 13:32:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-6d383e91-7ee6-4caa-be78-3e7fa3630471 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61" returned: 0 in 0.706s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:26 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=58, name=volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:26 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-6d383e91-7ee6-4caa-be78-3e7fa3630471 tempest-VolumesActionsTest-123140361 None] Detach volume completed successfully. Sep 10 13:32:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9202404d-a17b-4280-aab3-1f2109689c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35f9579-8a87-4637-abb3-509e219ff708', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388f17bc-036a-47b3-bf6e-3244da2cb24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 1G" returned: 0 in 0.604s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:27 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Volume volume-b35f9579-8a87-4637-abb3-509e219ff708 (b35f9579-8a87-4637-abb3-509e219ff708): created successfully Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388f17bc-036a-47b3-bf6e-3244da2cb24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Flow 'volume_create_manager' (1749758a-d406-4b38-8e29-97d501d37873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d383e91-7ee6-4caa-be78-3e7fa3630471 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-detach_volume" released by "detach_volume" :: held 1.202s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0c108517-19d5-4745-961d-14cbcf49bd30 tempest-TaggedBootDevicesTest-1645062834 None] Created volume successfully. Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.436s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.302s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.172s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.info" returned: 0 in 0.154s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:28 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:32:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.info" returned: 0 in 0.174s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.083s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-dc0b6632-a5b5-4322-ac04-a6f91a6838cf tempest-SnapshotsActionsTest-287245114 None] Create snapshot completed successfully Sep 10 13:32:29 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Flow 'volume_create_manager' (656aff58-b88f-4bb2-8f76-2cc527fb115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa6bf7e-32fd-4e9e-a50b-e77361e5fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa6bf7e-32fd-4e9e-a50b-e77361e5fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1884186303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6ce55d-5a86-4dfe-9958-e7beaee660d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16010be302147d69781676059855460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:29Z,use_quota=True,user_id='beff7b30ebf34434841285ca44f8ae7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb29b8a-05d7-4362-aa0c-d06b130df1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb29b8a-05d7-4362-aa0c-d06b130df1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad62481b-570e-49fb-a07c-8d03cb833a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad62481b-570e-49fb-a07c-8d03cb833a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6ce55d-5a86-4dfe-9958-e7beaee660d9', 'volume_name': 'volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b688d572-3446-465c-bdc7-54ae58f68ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b688d572-3446-465c-bdc7-54ae58f68ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8354348e-b475-4413-b285-3f129cc070d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:29 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Volume 0d6ce55d-5a86-4dfe-9958-e7beaee660d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9', 'volume_size': 1} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1884186303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6ce55d-5a86-4dfe-9958-e7beaee660d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16010be302147d69781676059855460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:29Z,use_quota=True,user_id='beff7b30ebf34434841285ca44f8ae7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Creating volume 0d6ce55d-5a86-4dfe-9958-e7beaee660d9 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:32:29 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:32:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:29 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=60, name=volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9 1073741824" returned: 0 in 0.938s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9" returned: 0 in 0.435s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] <== create_volume: return (1507ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:32:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8354348e-b475-4413-b285-3f129cc070d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329f502e-ffb1-44bd-8e4d-9caaf3f7c5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:31 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Volume volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9 (0d6ce55d-5a86-4dfe-9958-e7beaee660d9): created successfully Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329f502e-ffb1-44bd-8e4d-9caaf3f7c5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Flow 'volume_create_manager' (656aff58-b88f-4bb2-8f76-2cc527fb115c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3188bf59-78ec-4ed9-a1f5-41e4b846fcbd tempest-TaggedBootDevicesTest-1645062834 None] Created volume successfully. Sep 10 13:32:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Creating offline snapshot 2f1b92d7-30c7-411b-b754-9ea7e72d1b41 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eaa61c-d9b3-4bfa-b1df-060969f27595]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.474s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:32 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=61, name=volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 1G" returned: 0 in 0.515s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41" returned: 0 in 0.404s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Flow 'volume_create_manager' (f4537461-f266-4020-a6af-67f12d048e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221c510a-3ece-4ae7-9a31-1d4a0ac4bbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221c510a-3ece-4ae7-9a31-1d4a0ac4bbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-566012578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0778f4-49cc-4d95-8757-7a22ed424e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16010be302147d69781676059855460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:33Z,use_quota=True,user_id='beff7b30ebf34434841285ca44f8ae7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c9adbf-630e-4c94-b254-956c7e6a1a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c9adbf-630e-4c94-b254-956c7e6a1a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b0944e-d6bd-4c2e-82f0-da298db328c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b0944e-d6bd-4c2e-82f0-da298db328c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0778f4-49cc-4d95-8757-7a22ed424e89', 'volume_name': 'volume-2e0778f4-49cc-4d95-8757-7a22ed424e89', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b26da4-6fcf-49ae-8c57-7a33af7a3878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b26da4-6fcf-49ae-8c57-7a33af7a3878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447219ef-d430-4cc4-9bda-f3147f7de596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:34 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Volume 2e0778f4-49cc-4d95-8757-7a22ed424e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0778f4-49cc-4d95-8757-7a22ed424e89', 'volume_size': 1} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41" returned: 0 in 0.719s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41" returned: 0 in 0.163s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-566012578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0778f4-49cc-4d95-8757-7a22ed424e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16010be302147d69781676059855460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:33Z,use_quota=True,user_id='beff7b30ebf34434841285ca44f8ae7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Creating volume 2e0778f4-49cc-4d95-8757-7a22ed424e89 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:32:34 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:32:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:34 devstack quobyte-client[83260]: System call of process 90010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:34 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=62, name=volume-2e0778f4-49cc-4d95-8757-7a22ed424e89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89 1073741824" returned: 0 in 0.700s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89" returned: 0 in 0.124s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] <== create_volume: return (975ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:35 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-afd37027-5d80-4016-a234-b342777ba6a9 tempest-SnapshotsActionsTest-287245114 None] Create snapshot completed successfully Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447219ef-d430-4cc4-9bda-f3147f7de596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0778f4-49cc-4d95-8757-7a22ed424e89', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f25909-e6ee-4766-8659-f6abcc5eec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:32:35 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Volume volume-2e0778f4-49cc-4d95-8757-7a22ed424e89 (2e0778f4-49cc-4d95-8757-7a22ed424e89): created successfully Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f25909-e6ee-4766-8659-f6abcc5eec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:32:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Flow 'volume_create_manager' (f4537461-f266-4020-a6af-67f12d048e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:32:35 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-dc2a6d15-61ed-4863-8aa3-15832368ec72 tempest-TaggedBootDevicesTest-1645062834 None] Created volume successfully. Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-2f1b92d7-30c7-411b-b754-9ea7e72d1b41-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-2f1b92d7-30c7-411b-b754-9ea7e72d1b41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-2f1b92d7-30c7-411b-b754-9ea7e72d1b41" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-2f1b92d7-30c7-411b-b754-9ea7e72d1b41" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Deleting offline snapshot 2f1b92d7-30c7-411b-b754-9ea7e72d1b41 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] snapshot_file for this snap is: volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e6393f-38cd-4f42-9419-7cecef14c569]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41" returned: 0 in 0.576s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c20d2f7-f206-4cef-a792-4a612618afc2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:37 devstack quobyte-client[83260]: System call of process 90019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.534s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41" returned: 0 in 0.391s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.2f1b92d7-30c7-411b-b754-9ea7e72d1b41" returned: 0 in 0.142s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-2f1b92d7-30c7-411b-b754-9ea7e72d1b41" released by "_delete_snapshot" :: held 2.125s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" released by "delete_snapshot" :: held 2.162s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:38 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Created reservations ['35ef2a8b-7af7-4f4c-b3d2-de9aba31297a', '840e98be-a111-4d44-8676-dacffa8aacc1', '7aaef47b-7193-4d81-9d74-b775330a3293', '93e19877-b63c-48f2-87af-a8a89897e508'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:32:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Delete snapshot completed successfully. Sep 10 13:32:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f25f99e9-e1f6-47c7-9658-871d6f77f8d9 tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-2f1b92d7-30c7-411b-b754-9ea7e72d1b41-delete_snapshot" released by "delete_snapshot" :: held 2.873s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Creating offline snapshot d8d6edd5-6813-41a5-ba09-11768872f070 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c244c7b-0410-44fa-a3d1-14c9b85f1294]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.526s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:40 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=63, name=volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 1G" returned: 0 in 0.316s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070" returned: 0 in 0.194s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070" returned: 0 in 0.193s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070" returned: 0 in 0.170s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.759s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a1e3e70a-7628-4a8a-bbee-b2eb851fc094 tempest-SnapshotsActionsTest-287245114 None] Create snapshot completed successfully Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-d8d6edd5-6813-41a5-ba09-11768872f070-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-d8d6edd5-6813-41a5-ba09-11768872f070-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:43 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-d8d6edd5-6813-41a5-ba09-11768872f070" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-d8d6edd5-6813-41a5-ba09-11768872f070" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Deleting offline snapshot d8d6edd5-6813-41a5-ba09-11768872f070 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] snapshot_file for this snap is: volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d12a0c-5227-4952-924a-e4fb42fa1d5c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070" returned: 0 in 0.555s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:44 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ceba8f-9593-402d-9e34-065ad0b2ef7a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:44 devstack quobyte-client[83260]: System call of process 90042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.594s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070" returned: 0 in 0.322s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.d8d6edd5-6813-41a5-ba09-11768872f070" returned: 0 in 0.119s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-d8d6edd5-6813-41a5-ba09-11768872f070" released by "_delete_snapshot" :: held 1.974s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" released by "delete_snapshot" :: held 2.006s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:45 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=50,cinder:UPDATE=52,cinder:DELETE=2,cinder:INSERT=15 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:32:45 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=56,cinder:UPDATE=38,cinder:DELETE=7,cinder:INSERT=13 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:32:46 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Created reservations ['f59e95b8-c1de-41aa-852e-bff78abda0dd', 'e55747a2-284c-4eb2-8dbe-75b4dba0476b', '5279c547-aad8-4a09-9575-2581ef71a59c', 'b707cdd2-ae60-41c8-9096-92f9facea653'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:32:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Delete snapshot completed successfully. Sep 10 13:32:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9285db87-d013-4581-a1a8-6400a87e268c tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-d8d6edd5-6813-41a5-ba09-11768872f070-delete_snapshot" released by "delete_snapshot" :: held 2.945s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Creating offline snapshot bc7105ff-7f15-412d-abbd-e9ab937da3d0 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:32:47 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae719911-a9bb-426b-966e-c5251faf2f0c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:48 devstack quobyte-client[83260]: System call of process 90055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.730s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:48 devstack quobyte-client[83260]: System call of process 90065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:49 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=64, name=volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 1G" returned: 0 in 0.597s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:49 devstack quobyte-client[83260]: System call of process 90069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0" returned: 0 in 0.178s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0" returned: 0 in 0.240s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:32:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0" returned: 0 in 0.226s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0d545a2b-1f05-4be9-8de5-e70f6bfc7c42 tempest-SnapshotsActionsTest-287245114 None] Create snapshot completed successfully Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-bc7105ff-7f15-412d-abbd-e9ab937da3d0-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-bc7105ff-7f15-412d-abbd-e9ab937da3d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-bc7105ff-7f15-412d-abbd-e9ab937da3d0" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-bc7105ff-7f15-412d-abbd-e9ab937da3d0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Deleting offline snapshot bc7105ff-7f15-412d-abbd-e9ab937da3d0 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] snapshot_file for this snap is: volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d603f4ef-77c3-4610-bde0-66a0c95109f0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0" returned: 0 in 0.521s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[207805aa-306f-4cc1-a074-1e412cfd8d69]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.577s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0" returned: 0 in 0.303s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.bc7105ff-7f15-412d-abbd-e9ab937da3d0" returned: 0 in 0.116s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-bc7105ff-7f15-412d-abbd-e9ab937da3d0" released by "_delete_snapshot" :: held 1.876s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" released by "delete_snapshot" :: held 1.902s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:53 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Created reservations ['6efea375-76dd-46a9-abee-92e913ffb9a4', '7237a796-5984-4372-8138-be0bddfefa00', '0db4b7e9-5d69-4f44-940d-ebe48a67ecaf', '84c89b4e-374c-4807-98ae-f2a62e6e18b5'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:32:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Delete snapshot completed successfully. Sep 10 13:32:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c0e78723-ad42-4167-85a1-df35a4f0f23a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-bc7105ff-7f15-412d-abbd-e9ab937da3d0-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:32:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:32:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:32:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Creating offline snapshot 206cd05d-8e05-4410-a54f-de0c2941da10 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:32:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[615b1b2c-5998-44e9-9ef6-39400263edab]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:56 devstack quobyte-client[83260]: System call of process 90093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:32:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.708s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:32:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:56 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=65, name=volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:32:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 1G" returned: 0 in 0.491s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img rebase -u -b volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10" returned: 0 in 0.172s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10" returned: 0 in 0.128s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10" returned: 0 in 0.155s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:32:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:32:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-78591535-585a-4025-82f7-bbe70c49455f tempest-SnapshotsActionsTest-287245114 None] Create snapshot completed successfully Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-206cd05d-8e05-4410-a54f-de0c2941da10-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-206cd05d-8e05-4410-a54f-de0c2941da10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Acquiring lock "cinder-quobyte-206cd05d-8e05-4410-a54f-de0c2941da10" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-206cd05d-8e05-4410-a54f-de0c2941da10" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Deleting offline snapshot 206cd05d-8e05-4410-a54f-de0c2941da10 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] snapshot_file for this snap is: volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6221b-067a-44ae-826f-0777aeb214f1]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:32:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:01 devstack quobyte-client[83260]: System call of process 90138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:33:01 devstack quobyte-client[83260]: System call of process 90138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:33:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10" returned: 0 in 1.674s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:33:01 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ea094b-bfba-4a42-9432-6d435541aefc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.752s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:33:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:02 devstack quobyte-client[83260]: System call of process 90177 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:33:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10" returned: 0 in 0.444s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.206cd05d-8e05-4410-a54f-de0c2941da10" returned: 0 in 0.154s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-206cd05d-8e05-4410-a54f-de0c2941da10" released by "_delete_snapshot" :: held 3.922s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" released by "delete_snapshot" :: held 3.994s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:04 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Created reservations ['9b54ffe8-61e9-40eb-91f0-36f2088da249', 'a2632647-fe88-4178-bc5e-a21c0990a664', '308dcbcb-9d9f-4409-9a8e-159217564993', 'd27e98d9-216b-4052-a50f-e07a1d07d616'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:33:04 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Delete snapshot completed successfully. Sep 10 13:33:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-505e47b5-9cbc-431e-98c5-a49504567c6a tempest-SnapshotsActionsTest-335336064 None] Lock "cinder-206cd05d-8e05-4410-a54f-de0c2941da10-delete_snapshot" released by "delete_snapshot" :: held 5.245s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "cinder-5ba104ae-7201-4b1b-9958-e06d76c50f26-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:33:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-5ba104ae-7201-4b1b-9958-e06d76c50f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:33:06 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:33:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:33:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "cinder-quobyte-5ba104ae-7201-4b1b-9958-e06d76c50f26" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:33:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-quobyte-5ba104ae-7201-4b1b-9958-e06d76c50f26" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:33:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Deleting offline snapshot 5ba104ae-7201-4b1b-9958-e06d76c50f26 of volume 154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:33:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] snapshot_file for this snap is: volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:33:07 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d145a1c7-615d-4b9b-8983-2c0a6ff6adf9]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 0.941s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154c745e-c961-4c0f-b96d-feca36680b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:33:08 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd520f75-8771-4de2-afff-6ff232904bdc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:09 devstack quobyte-client[83260]: System call of process 90206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:33:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61" returned: 0 in 1.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:10 devstack quobyte-client[83260]: System call of process 90217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:33:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-582ac02f-d985-41ab-8347-fe39933ae096 tempest-VolumesActionsTest-123140361 None] Acquiring lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35" by "attach_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:33:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:33:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:33:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-582ac02f-d985-41ab-8347-fe39933ae096 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35" acquired by "attach_volume" :: waited 0.926s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:33:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 1.744s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:11 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49c20ae-b9f9-47a5-971e-dfbbccc572e0]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61.5ba104ae-7201-4b1b-9958-e06d76c50f26" returned: 0 in 1.159s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:12 devstack quobyte-client[83260]: System call of process 90222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:33:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-quobyte-5ba104ae-7201-4b1b-9958-e06d76c50f26" released by "_delete_snapshot" :: held 6.125s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" released by "delete_snapshot" :: held 6.230s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 0 in 1.351s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 1 in 0.730s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:33:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.715s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:33:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-582ac02f-d985-41ab-8347-fe39933ae096 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-582ac02f-d985-41ab-8347-fe39933ae096 tempest-VolumesActionsTest-123140361 None] Attaching volume 73e357c8-8d69-4095-b583-a9c82be7bd35 to instance 294dcd92-d362-4f21-a0a6-0c71ce359093 at mountpoint /dev/vdb on host None. Sep 10 13:33:14 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Created reservations ['202d7207-54fe-4060-9713-4dd4a937db52', 'a88f591c-67c1-4345-8945-ff7d24a9003c', 'dba84e08-5b40-41a9-9c05-31b819e0fda0', 'eab86dcf-7175-4a13-9836-6e290b6045a0'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:33:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-582ac02f-d985-41ab-8347-fe39933ae096 tempest-VolumesActionsTest-123140361 None] Attach volume completed successfully. Sep 10 13:33:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-b35f9579-8a87-4637-abb3-509e219ff708', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bde6ff03-ab68-438b-b540-ea87f9c786f5', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:33:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-582ac02f-d985-41ab-8347-fe39933ae096 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35" released by "attach_volume" :: held 3.323s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Delete snapshot completed successfully. Sep 10 13:33:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d840482c-ecdc-4931-9d59-76b7038694ff tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-5ba104ae-7201-4b1b-9958-e06d76c50f26-delete_snapshot" released by "delete_snapshot" :: held 8.228s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:15 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-e9f9d977-377c-4f21-a719-813990973a4e tempest-TaggedBootDevicesTest-1645062834 None] attachment_update completed successfully. Sep 10 13:33:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-69516038-a772-4c82-97d1-979c41821c60 tempest-VolumesActionsTest-123140361 None] Acquiring lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-detach_volume" by "detach_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:33:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "cinder-154c745e-c961-4c0f-b96d-feca36680b61-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:33:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-69516038-a772-4c82-97d1-979c41821c60 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:33:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-69516038-a772-4c82-97d1-979c41821c60 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:15 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-69516038-a772-4c82-97d1-979c41821c60 tempest-VolumesActionsTest-123140361 None] Detaching volume 73e357c8-8d69-4095-b583-a9c82be7bd35 from instance 294dcd92-d362-4f21-a0a6-0c71ce359093. Sep 10 13:33:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-69516038-a772-4c82-97d1-979c41821c60 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-154c745e-c961-4c0f-b96d-feca36680b61-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:33:16 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:33:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" acquired by "delete_volume" :: waited 0.045s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:33:16 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18736c37-18d7-41dc-a793-1322ecb45ed0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-69516038-a772-4c82-97d1-979c41821c60 tempest-VolumesActionsTest-123140361 None] Detach volume completed successfully. Sep 10 13:33:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-69516038-a772-4c82-97d1-979c41821c60 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-detach_volume" released by "detach_volume" :: held 0.920s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61" returned: 0 in 1.203s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-154c745e-c961-4c0f-b96d-feca36680b61" returned: 0 in 0.431s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:18 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-quobyte-154c745e-c961-4c0f-b96d-feca36680b61" released by "delete_volume" :: held 2.251s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:18 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Created reservations ['798dc078-c8fb-4927-abe4-b810d208f0b8', '744f3883-dca9-4aa6-9645-f981a0cb0ea1', 'f9d82ad7-356a-4b07-ab4d-3fd3f4bbdefc', 'ac6dfad1-ce8f-4b9d-bd0a-8e8d16a7b257'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:33:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:33:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:33:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:33:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:33:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:33:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 1.623s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:21 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:33:21 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Deleted volume successfully. Sep 10 13:33:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:33:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:33:21 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f308901b-5d79-4c68-b0bf-17ee13b97e59]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:22 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9e215cdd-8c77-47ee-aa7e-b6f51687148b tempest-SnapshotsActionsTest-287245114 None] Lock "cinder-154c745e-c961-4c0f-b96d-feca36680b61-delete_volume" released by "delete_volume" :: held 6.033s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:33:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9" returned: 0 in 0.920s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:33:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2a3be1d-703c-429f-8196-dcb32c9794b8', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:33:23 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-5386151f-ed94-4771-85d0-dc72e723e09c tempest-TaggedBootDevicesTest-1645062834 None] attachment_update completed successfully. Sep 10 13:33:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:33:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:33:26 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e60247-0ff6-45c0-8af9-4bb0b52dd889]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89" returned: 0 in 0.573s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.689s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:33:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-2e0778f4-49cc-4d95-8757-7a22ed424e89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3565ca2-050d-427d-b4a5-92958cf67279', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:33:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-f40a72aa-dbf9-418e-b572-150a463c90c5 req-fa2b3cfe-9c19-4587-9f3e-ecdd2cad4a35 tempest-TaggedBootDevicesTest-1645062834 None] attachment_update completed successfully. Sep 10 13:33:34 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:33:34 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Flow 'volume_create_manager' (d9741bd0-d653-40ef-8929-65bc2824ff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60335aa2-8eba-4cdd-8064-e31fb9ec861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6280cc-b7a3-43ce-a364-fab1d1954f35]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60335aa2-8eba-4cdd-8064-e31fb9ec861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1111008443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655bdf76-2ef9-43f9-adcc-260eeaa22b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9b5ababbd1487193066257e1e239ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:33:34Z,use_quota=True,user_id='9a809674ea1b449da2cfafca82076475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(007fdb15-e396-492f-b5a2-6708898c2854),volume_type_id=007fdb15-e396-492f-b5a2-6708898c2854)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da04c1ca-d25d-4865-be5e-b4860c4d86f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da04c1ca-d25d-4865-be5e-b4860c4d86f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:33:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947c5696-e7f4-4912-9dc2-1dd4c44d8bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947c5696-e7f4-4912-9dc2-1dd4c44d8bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655bdf76-2ef9-43f9-adcc-260eeaa22b35', 'volume_name': 'volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc85bf2-81cf-4303-869f-3d5ec8e12dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc85bf2-81cf-4303-869f-3d5ec8e12dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a8cc50-58c7-4658-ac81-ddb272c23746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:33:35 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Volume 655bdf76-2ef9-43f9-adcc-260eeaa22b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35', 'volume_size': 1} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 0.682s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d03b2ec-05d6-4337-9bba-1d205e445a11]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:36 devstack quobyte-client[83260]: System call of process 90312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:33:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 1.185s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.2afcb569-c3ff-497b-906f-5c635219265c34b6_r28.img {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:44 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=47,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:33:44 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=47,cinder:SELECT=52,cinder:DELETE=2,cinder:INSERT=14 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:33:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.2afcb569-c3ff-497b-906f-5c635219265c34b6_r28.img" returned: 0 in 8.051s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:44 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3534dd7-8fbc-4594-a348-52f3b1906cad]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:33:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:33:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 0.732s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:33:45 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Image conversion details: src /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.2afcb569-c3ff-497b-906f-5c635219265c34b6_r28.img {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:33:45 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Converted 1024.00 MB image at 127.00 MB/s Sep 10 13:33:45 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] 2afcb569-c3ff-497b-906f-5c635219265c was raw, no need to convert to raw {{(pid=83206) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 10 13:33:55 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:33:55 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:34:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:34:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:34:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:34:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:34:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:34:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:34:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.793s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:34:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:34:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 74.037s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Uploaded volume to glance image-id: 2afcb569-c3ff-497b-906f-5c635219265c. {{(pid=83206) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 73.310s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1111008443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655bdf76-2ef9-43f9-adcc-260eeaa22b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9b5ababbd1487193066257e1e239ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:33:34Z,use_quota=True,user_id='9a809674ea1b449da2cfafca82076475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(007fdb15-e396-492f-b5a2-6708898c2854),volume_type_id=007fdb15-e396-492f-b5a2-6708898c2854)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Creating volume 655bdf76-2ef9-43f9-adcc-260eeaa22b35 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:34:48 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:34:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:48 devstack quobyte-client[83260]: System call of process 91281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:34:48 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=66, name=volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:34:49 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c5fdd346-703b-4237-9dfc-c78ca57ec8e2 tempest-VolumesActionsTest-123140361 None] Copy volume to image completed successfully. Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35 1073741824" returned: 0 in 0.846s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35" returned: 0 in 0.116s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] <== create_volume: return (1055ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a8cc50-58c7-4658-ac81-ddb272c23746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754e0a55-fa6d-4d69-addd-d007e5838dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:34:49 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Volume volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35 (655bdf76-2ef9-43f9-adcc-260eeaa22b35): created successfully Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754e0a55-fa6d-4d69-addd-d007e5838dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:34:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Flow 'volume_create_manager' (d9741bd0-d653-40ef-8929-65bc2824ff4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:34:49 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9273672b-2fe9-4770-9433-e3a33e9b6d99 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Created volume successfully. Sep 10 13:34:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5809455-dcc3-40a9-9534-6af1815684dc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:34:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:34:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.153s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:52 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:34:52 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-01d3dff0-6cfb-4d14-8ceb-28850f24b019 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Retype volume completed successfully. Sep 10 13:34:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 1.092s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:52 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a818c-b0b2-44ec-a54e-e00f0e2ea613]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:34:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Acquiring lock "cinder-655bdf76-2ef9-43f9-adcc-260eeaa22b35-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:34:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "cinder-655bdf76-2ef9-43f9-adcc-260eeaa22b35-delete_volume" acquired by "delete_volume" :: waited 0.226s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:34:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 1.027s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:53 devstack quobyte-client[83260]: System call of process 91293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:34:53 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:34:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Acquiring lock "cinder-quobyte-655bdf76-2ef9-43f9-adcc-260eeaa22b35" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:34:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "cinder-quobyte-655bdf76-2ef9-43f9-adcc-260eeaa22b35" acquired by "delete_volume" :: waited 0.149s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:34:54 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0823502-c739-4607-9378-7fc7f065c449]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:34:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:56 devstack quobyte-client[83260]: System call of process 91304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:34:56 devstack quobyte-client[83260]: System call of process 91304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:34:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35" returned: 0 in 2.564s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-655bdf76-2ef9-43f9-adcc-260eeaa22b35" returned: 0 in 0.478s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "cinder-quobyte-655bdf76-2ef9-43f9-adcc-260eeaa22b35" released by "delete_volume" :: held 3.634s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:34:57 devstack cinder-volume[83206]: WARNING cinder.quota [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:34:57 devstack cinder-volume[83206]: WARNING cinder.quota [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:34:58 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Created reservations ['5241f763-b8e3-4c9c-bcca-03acf4068d2a', '868d5d68-6360-4db4-b3c5-62240241d71a', '1af0a701-6d9e-4848-8807-efb85b81fc6f', '4c02af6e-fd19-44c2-b6b3-76a298e53d54'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:34:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:34:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:34:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:34:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:34:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.177s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:34:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:34:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.542s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:34:59 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:34:59 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Deleted volume successfully. Sep 10 13:35:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2f269ccd-01d5-4baa-9bec-d7e9fe00fd75 tempest-VolumeRetypeWithoutMigrationTest-812488164 None] Lock "cinder-655bdf76-2ef9-43f9-adcc-260eeaa22b35-delete_volume" released by "delete_volume" :: held 7.983s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img" returned: 0 in 11.744s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:05 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e7786c-aca6-4cb2-8b7c-f225761937a8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 0.885s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:06 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Image conversion details: src /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35, size 1024.00 MB, duration 11.75 sec, destination /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:35:06 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Converted 1024.00 MB image at 87.16 MB/s Sep 10 13:35:06 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] ab31c0af-980b-4604-b4d5-67dc6702aea0 was raw, converting to qcow2 {{(pid=83206) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 10 13:35:06 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[63157207-3953-4f8d-b98c-5c204c10d8c9]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img" returned: 0 in 0.640s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img" returned: 1 in 0.738s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:35:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img /opt/stack/data/cinder/conversion/vol_upload_493dcq3e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img /opt/stack/data/cinder/conversion/vol_upload_493dcq3e" returned: 0 in 0.230s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:08 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Image conversion details: src /opt/stack/data/cinder/conversion/73e357c8-8d69-4095-b583-a9c82be7bd35.temp_image.ab31c0af-980b-4604-b4d5-67dc6702aea0lihn77iv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_493dcq3e {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:35:08 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 13:35:08 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb709be-2d61-40fa-9ab5-e0cc2de510b5]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_493dcq3e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_493dcq3e" returned: 0 in 0.545s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:10 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=17,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 19.818s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Uploaded volume to glance image-id: ab31c0af-980b-4604-b4d5-67dc6702aea0. {{(pid=83206) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:11 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0c99a4b2-a0aa-4b6e-88cc-706277df0bdc tempest-VolumesActionsTest-123140361 None] Copy volume to image completed successfully. Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.396s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Acquiring lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:13 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Acquiring lock "cinder-quobyte-73e357c8-8d69-4095-b583-a9c82be7bd35" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Lock "cinder-quobyte-73e357c8-8d69-4095-b583-a9c82be7bd35" acquired by "delete_volume" :: waited 0.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:13 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebad493e-d1fc-48da-8b81-eece47787955]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:14 devstack quobyte-client[83260]: System call of process 91341 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 0.931s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:14 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:35:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Flow 'volume_create_manager' (7abea0c0-f673-40cb-bbfe-d0a3633b795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2df2456-579b-40b0-8958-fbde048bfea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-73e357c8-8d69-4095-b583-a9c82be7bd35" returned: 0 in 0.469s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2df2456-579b-40b0-8958-fbde048bfea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1065651630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecee6aeb66c473a87bbf372f8ce3f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:14Z,use_quota=True,user_id='bfa32d5870a648c3ad3edb2686acc6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac47ac0-4f50-45d8-ae8a-55560993edd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac47ac0-4f50-45d8-ae8a-55560993edd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832b5692-0d7f-4e7e-818a-5d65d39632a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832b5692-0d7f-4e7e-818a-5d65d39632a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7', 'volume_name': 'volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2108cbc-d465-4c57-bbbd-a089519950f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2108cbc-d465-4c57-bbbd-a089519950f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726ba50e-95da-4bf9-b641-756f85beb161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:15 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Volume fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7', 'volume_size': 1} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1065651630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecee6aeb66c473a87bbf372f8ce3f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:14Z,use_quota=True,user_id='bfa32d5870a648c3ad3edb2686acc6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Creating volume fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:35:15 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:15 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=67, name=volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Lock "cinder-quobyte-73e357c8-8d69-4095-b583-a9c82be7bd35" released by "delete_volume" :: held 1.745s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7 1073741824" returned: 0 in 0.573s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:15 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Created reservations ['8c1e6197-a84c-4740-940f-b43ef9de0825', '4311cea5-b995-4bf5-b156-751744e3a880', 'fe2ca576-0770-477e-923a-b3dd6f1f9f49', 'ffa62e98-c26c-48d0-93a3-b725c0c7fa3e'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7" returned: 0 in 0.314s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] <== create_volume: return (919ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726ba50e-95da-4bf9-b641-756f85beb161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e13d1ac-6c81-4118-8504-c0c2cbb1c862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:16 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Volume volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7 (fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7): created successfully Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e13d1ac-6c81-4118-8504-c0c2cbb1c862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Flow 'volume_create_manager' (7abea0c0-f673-40cb-bbfe-d0a3633b795a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0bebe96d-367c-47f1-ae58-a7214ee9cbe0 tempest-VolumesServicesTestJSON-978274591 None] Created volume successfully. Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.185s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:16 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Deleted volume successfully. Sep 10 13:35:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1a38490-411f-410e-95e8-19fb4a3326e2 tempest-VolumesActionsTest-123140361 None] Lock "cinder-73e357c8-8d69-4095-b583-a9c82be7bd35-delete_volume" released by "delete_volume" :: held 3.734s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Acquiring lock "cinder-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Lock "cinder-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:18 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Acquiring lock "cinder-quobyte-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:18 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Lock "cinder-quobyte-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7" acquired by "delete_volume" :: waited 0.084s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:18 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0a223-0cd8-4533-b9d1-e7ce3caad218]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7" returned: 0 in 0.637s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7" returned: 0 in 0.170s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:19 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Lock "cinder-quobyte-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7" released by "delete_volume" :: held 1.033s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:19 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Created reservations ['79d7f4da-25cb-4305-8583-0c229d10e237', 'e7140be2-b013-4ed2-9c90-df7b02a409aa', '42370f61-9825-4cf9-ac2d-1614761abf75', 'ec3b5d55-40aa-4c91-a9bd-fbf98790f6d2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.303s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:20 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Deleted volume successfully. Sep 10 13:35:20 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bad6d641-1a78-4cd3-8ea8-215a355b8a5e tempest-VolumesServicesTestJSON-978274591 None] Lock "cinder-fdf4ae3a-aa20-477b-8a89-11f4ee0a80b7-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:29 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:35:30 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=30,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:35:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:33 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (4e8236a0-140f-4520-a250-ee8b79fea232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283f998d-189f-473f-9084-107dac0c25f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283f998d-189f-473f-9084-107dac0c25f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1182528321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24116a4b-77a3-46c1-b1ed-b54c18bad662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:34Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e6b693-c8b8-4acf-a8cf-55f1dea22a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e6b693-c8b8-4acf-a8cf-55f1dea22a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94564b92-e3f4-43af-9b29-64d8e321c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94564b92-e3f4-43af-9b29-64d8e321c89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24116a4b-77a3-46c1-b1ed-b54c18bad662', 'volume_name': 'volume-24116a4b-77a3-46c1-b1ed-b54c18bad662', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efc0e5e-f17e-45e2-8204-e7f8af446631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efc0e5e-f17e-45e2-8204-e7f8af446631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca89bb1-dfd6-4fd0-ae1f-c476299fa351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:34 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Volume 24116a4b-77a3-46c1-b1ed-b54c18bad662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24116a4b-77a3-46c1-b1ed-b54c18bad662', 'volume_size': 1} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1182528321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24116a4b-77a3-46c1-b1ed-b54c18bad662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:34Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Creating volume 24116a4b-77a3-46c1-b1ed-b54c18bad662 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:35:34 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:35:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:34 devstack quobyte-client[83260]: System call of process 91367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:34 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=68, name=volume-24116a4b-77a3-46c1-b1ed-b54c18bad662, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662 1073741824" returned: 0 in 0.957s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:35 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (3616eb01-1d55-4925-9a1a-1d39ffd2a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae16bea-2bac-45a0-bb32-4b8e53eb60f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae16bea-2bac-45a0-bb32-4b8e53eb60f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386385157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e7bcd8-c26c-438d-824b-5c9419cac9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:35Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd993f6e-3906-47e4-9616-62f972a9959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd993f6e-3906-47e4-9616-62f972a9959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d357000b-c277-4815-a1f1-761a75847c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d357000b-c277-4815-a1f1-761a75847c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e7bcd8-c26c-438d-824b-5c9419cac9bb', 'volume_name': 'volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce6e28b-2cdf-4445-83e4-a3122889dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce6e28b-2cdf-4445-83e4-a3122889dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6502999-1e8c-4a59-9058-69583fb7ca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:35 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Volume 78e7bcd8-c26c-438d-824b-5c9419cac9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb', 'volume_size': 1} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662" returned: 0 in 0.793s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] <== create_volume: return (1788ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:35 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (66d0980a-6979-4526-8b71-7db83e9ce3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fe22cc-585d-4144-a324-0af3873b8e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386385157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e7bcd8-c26c-438d-824b-5c9419cac9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:35Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Creating volume 78e7bcd8-c26c-438d-824b-5c9419cac9bb {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:35:36 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:36 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=69, name=volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fe22cc-585d-4144-a324-0af3873b8e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243358939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b803bf01-aa67-42f7-b254-c9d86d17b600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:35Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d62703-6eec-49fc-9db6-a6fbfdd8829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d62703-6eec-49fc-9db6-a6fbfdd8829f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d40467-7efb-4406-97d2-e198b2336867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d40467-7efb-4406-97d2-e198b2336867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b803bf01-aa67-42f7-b254-c9d86d17b600', 'volume_name': 'volume-b803bf01-aa67-42f7-b254-c9d86d17b600', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c204e0-d1b6-45e4-a4be-ceb9cc1ad9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c204e0-d1b6-45e4-a4be-ceb9cc1ad9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dec02d2-51e5-4ef7-addc-a239f07056fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:36 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Volume b803bf01-aa67-42f7-b254-c9d86d17b600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b803bf01-aa67-42f7-b254-c9d86d17b600', 'volume_size': 1} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca89bb1-dfd6-4fd0-ae1f-c476299fa351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24116a4b-77a3-46c1-b1ed-b54c18bad662', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799ef188-6e09-453e-a91a-4a1217a2f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb 1073741824" returned: 0 in 0.633s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:36 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Volume volume-24116a4b-77a3-46c1-b1ed-b54c18bad662 (24116a4b-77a3-46c1-b1ed-b54c18bad662): created successfully Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799ef188-6e09-453e-a91a-4a1217a2f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (4e8236a0-140f-4520-a250-ee8b79fea232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb" returned: 0 in 0.567s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] <== create_volume: return (1221ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243358939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b803bf01-aa67-42f7-b254-c9d86d17b600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:35Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Creating volume b803bf01-aa67-42f7-b254-c9d86d17b600 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:35:37 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:37 devstack quobyte-client[83260]: System call of process 91376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:37 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=70, name=volume-b803bf01-aa67-42f7-b254-c9d86d17b600, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:35:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-07c07614-4bf9-45b4-88cb-d70146a60846 tempest-CreateVolumesFromImageTest-92917229 None] Created volume successfully. Sep 10 13:35:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:37 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (b5980691-67ad-4a37-ab53-5f2ef733b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880fef2-2291-417e-ba98-620316aa1f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6502999-1e8c-4a59-9058-69583fb7ca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb08b66-6e20-45ef-b771-217b07afc736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600 1073741824" returned: 0 in 0.850s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880fef2-2291-417e-ba98-620316aa1f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1970838292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c850bc-e518-4410-9244-dc9f16b38173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:37Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d74d3-6972-4a0b-87e0-7fdb3e51fde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d74d3-6972-4a0b-87e0-7fdb3e51fde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724649ed-f504-46a4-b293-b3f171577a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724649ed-f504-46a4-b293-b3f171577a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c850bc-e518-4410-9244-dc9f16b38173', 'volume_name': 'volume-65c850bc-e518-4410-9244-dc9f16b38173', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11454be5-5bf6-4f31-92d8-67a193fc176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11454be5-5bf6-4f31-92d8-67a193fc176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57282be1-ad6d-4501-b46a-f47d7f090698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:38 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Volume 65c850bc-e518-4410-9244-dc9f16b38173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c850bc-e518-4410-9244-dc9f16b38173', 'volume_size': 1} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:38 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Volume volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb (78e7bcd8-c26c-438d-824b-5c9419cac9bb): created successfully Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb08b66-6e20-45ef-b771-217b07afc736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (3616eb01-1d55-4925-9a1a-1d39ffd2a946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600" returned: 0 in 0.637s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] <== create_volume: return (1547ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1970838292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c850bc-e518-4410-9244-dc9f16b38173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:37Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Creating volume 65c850bc-e518-4410-9244-dc9f16b38173 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:35:38 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:35:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:39 devstack quobyte-client[83260]: System call of process 91390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:39 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=71, name=volume-65c850bc-e518-4410-9244-dc9f16b38173, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:35:40 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-089aea17-c612-48e4-add6-5ef96b26d481 tempest-CreateVolumesFromImageTest-92917229 None] Created volume successfully. Sep 10 13:35:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:40 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:35:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (23df8408-afbe-4f9b-b48c-82ca9dddd00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3779eca-5a1c-4e84-a84a-c95dbb2948a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dec02d2-51e5-4ef7-addc-a239f07056fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b803bf01-aa67-42f7-b254-c9d86d17b600', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693e3332-1334-4b0d-b9e3-febb9c72f801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173 1073741824" returned: 0 in 1.840s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3779eca-5a1c-4e84-a84a-c95dbb2948a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762065864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8912030a-db4d-481c-8076-4b4796f4863b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:37Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b48c65-dd3c-45f0-b48c-54c28ee06cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b48c65-dd3c-45f0-b48c-54c28ee06cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b4469f-5e5a-4c90-9474-09d3534ed4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b4469f-5e5a-4c90-9474-09d3534ed4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8912030a-db4d-481c-8076-4b4796f4863b', 'volume_name': 'volume-8912030a-db4d-481c-8076-4b4796f4863b', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e5a1ac-f895-4a4d-b26b-d193fdfe06cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e5a1ac-f895-4a4d-b26b-d193fdfe06cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d38a6d-f1a2-4556-bd51-2d5241147e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Volume 8912030a-db4d-481c-8076-4b4796f4863b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8912030a-db4d-481c-8076-4b4796f4863b', 'volume_size': 1} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Volume volume-b803bf01-aa67-42f7-b254-c9d86d17b600 (b803bf01-aa67-42f7-b254-c9d86d17b600): created successfully Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693e3332-1334-4b0d-b9e3-febb9c72f801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (66d0980a-6979-4526-8b71-7db83e9ce3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173" returned: 0 in 0.542s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] <== create_volume: return (2418ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762065864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8912030a-db4d-481c-8076-4b4796f4863b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6673ad2425479badeb0e8bf6785c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:37Z,use_quota=True,user_id='f50600766c6e4896b2b6869f7d7070eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Creating volume 8912030a-db4d-481c-8076-4b4796f4863b {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:35:41 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:41 devstack quobyte-client[83260]: System call of process 91417 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:41 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=72, name=volume-8912030a-db4d-481c-8076-4b4796f4863b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:35:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f0f9a8c4-6174-46c5-bd23-16308eff3c01 tempest-CreateVolumesFromImageTest-92917229 None] Created volume successfully. Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57282be1-ad6d-4501-b46a-f47d7f090698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c850bc-e518-4410-9244-dc9f16b38173', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc79a252-c86c-4ae5-8e53-16ccca42bfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b 1073741824" returned: 0 in 0.604s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:42 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Volume volume-65c850bc-e518-4410-9244-dc9f16b38173 (65c850bc-e518-4410-9244-dc9f16b38173): created successfully Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc79a252-c86c-4ae5-8e53-16ccca42bfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (b5980691-67ad-4a37-ab53-5f2ef733b74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2fdb767b-e6f5-4f44-96d2-21bf25f1c371 tempest-CreateVolumesFromImageTest-92917229 None] Created volume successfully. Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b" returned: 0 in 0.469s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] <== create_volume: return (1100ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d38a6d-f1a2-4556-bd51-2d5241147e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8912030a-db4d-481c-8076-4b4796f4863b', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325ed48e-3ce0-4d56-b5cf-147b02ea45eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:42 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Volume volume-8912030a-db4d-481c-8076-4b4796f4863b (8912030a-db4d-481c-8076-4b4796f4863b): created successfully Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325ed48e-3ce0-4d56-b5cf-147b02ea45eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Flow 'volume_create_manager' (23df8408-afbe-4f9b-b48c-82ca9dddd00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4bdcd72c-2f81-4692-8871-81137ad3dd34 tempest-CreateVolumesFromImageTest-92917229 None] Created volume successfully. Sep 10 13:35:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-8912030a-db4d-481c-8076-4b4796f4863b-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-8912030a-db4d-481c-8076-4b4796f4863b-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:43 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-quobyte-8912030a-db4d-481c-8076-4b4796f4863b" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-8912030a-db4d-481c-8076-4b4796f4863b" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dddab7-2bef-4660-93af-187de2e90201]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b" returned: 0 in 0.875s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:44 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Flow 'volume_create_manager' (e39d466d-7333-46b6-a211-2f3162abdb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1ca750-986d-4b44-b5b5-066dc471a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1ca750-986d-4b44-b5b5-066dc471a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1177248865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37044ef6-4a3e-4cb6-9c21-aac48b3eb774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4035960035a545e7b2a222b3804ba468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:44Z,use_quota=True,user_id='8ec70975ab814c2bb4275326062f3f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76739c8d-ed55-478d-abea-276e56f77611),volume_type_id=76739c8d-ed55-478d-abea-276e56f77611)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e95c1bd-3e20-41fa-bb59-fe6ce442dcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e95c1bd-3e20-41fa-bb59-fe6ce442dcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82df8d99-e292-4c5d-9424-20848a4f8707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82df8d99-e292-4c5d-9424-20848a4f8707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37044ef6-4a3e-4cb6-9c21-aac48b3eb774', 'volume_name': 'volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ca19ae-5b70-4528-96e1-6e7afbe9f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ca19ae-5b70-4528-96e1-6e7afbe9f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed50f46-c9af-47e6-982f-c57b4d93d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:44 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Volume 37044ef6-4a3e-4cb6-9c21-aac48b3eb774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774', 'volume_size': 1} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1177248865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37044ef6-4a3e-4cb6-9c21-aac48b3eb774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4035960035a545e7b2a222b3804ba468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:35:44Z,use_quota=True,user_id='8ec70975ab814c2bb4275326062f3f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76739c8d-ed55-478d-abea-276e56f77611),volume_type_id=76739c8d-ed55-478d-abea-276e56f77611)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Creating volume 37044ef6-4a3e-4cb6-9c21-aac48b3eb774 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:35:44 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:35:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8912030a-db4d-481c-8076-4b4796f4863b" returned: 0 in 0.957s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:45 devstack quobyte-client[83260]: System call of process 91425 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-8912030a-db4d-481c-8076-4b4796f4863b" released by "delete_volume" :: held 2.041s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:45 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=73, name=volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:35:45 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Created reservations ['c93746ec-f4c9-40c8-8610-ad22d4d0b463', '36bc4c5f-4e84-43be-b3df-0c9734e8aaeb', '8cc9a019-b8f9-48aa-a2b8-f596ada49ef5', '047b3cd7-1cab-4478-95c5-abf2c257816c'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774 1073741824" returned: 0 in 1.076s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774" returned: 0 in 0.335s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] <== create_volume: return (1523ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-65c850bc-e518-4410-9244-dc9f16b38173-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed50f46-c9af-47e6-982f-c57b4d93d49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33fdd3a-0db9-4227-8a05-ccae21e4f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.640s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:46 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:47 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Volume volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774 (37044ef6-4a3e-4cb6-9c21-aac48b3eb774): created successfully Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33fdd3a-0db9-4227-8a05-ccae21e4f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Flow 'volume_create_manager' (e39d466d-7333-46b6-a211-2f3162abdb45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:35:47 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Deleted volume successfully. Sep 10 13:35:47 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1c007572-a27a-4f22-a466-0305886ccfdf tempest-VolumeTypesAccessTest-1211506086 None] Created volume successfully. Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-65c850bc-e518-4410-9244-dc9f16b38173-delete_volume" acquired by "delete_volume" :: waited 0.331s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2162eb91-6ccb-4522-a225-5f4f04663a8b tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-8912030a-db4d-481c-8076-4b4796f4863b-delete_volume" released by "delete_volume" :: held 4.145s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-quobyte-65c850bc-e518-4410-9244-dc9f16b38173" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-65c850bc-e518-4410-9244-dc9f16b38173" acquired by "delete_volume" :: waited 0.032s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5887865-7b4f-48c0-84b7-7362addd4423]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173" returned: 0 in 0.607s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-65c850bc-e518-4410-9244-dc9f16b38173" returned: 0 in 0.167s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-65c850bc-e518-4410-9244-dc9f16b38173" released by "delete_volume" :: held 1.068s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Acquiring lock "cinder-37044ef6-4a3e-4cb6-9c21-aac48b3eb774-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Lock "cinder-37044ef6-4a3e-4cb6-9c21-aac48b3eb774-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:48 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Acquiring lock "cinder-quobyte-37044ef6-4a3e-4cb6-9c21-aac48b3eb774" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:48 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Created reservations ['18e5b9cc-783f-4500-bfb0-b8f109dea9ee', 'c48984cc-fe6f-49d0-8533-7d6c320581ad', 'b6f9d3fa-5127-4935-8cd2-71e86fe9dad0', 'bf84528a-8916-4e15-860c-41f89756e1eb'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:35:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Lock "cinder-quobyte-37044ef6-4a3e-4cb6-9c21-aac48b3eb774" acquired by "delete_volume" :: waited 0.047s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[643ee7b4-16ac-4978-8c4b-8aa00e685fcd]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.125s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.094s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:49 devstack quobyte-client[83260]: System call of process 91437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:49 devstack quobyte-client[83260]: System call of process 91437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774" returned: 0 in 1.013s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.269s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-b803bf01-aa67-42f7-b254-c9d86d17b600-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Deleted volume successfully. Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-37044ef6-4a3e-4cb6-9c21-aac48b3eb774" returned: 0 in 0.659s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9706e09e-3fa3-421b-b386-49c4f572c9a4 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-65c850bc-e518-4410-9244-dc9f16b38173-delete_volume" released by "delete_volume" :: held 3.812s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-b803bf01-aa67-42f7-b254-c9d86d17b600-delete_volume" acquired by "delete_volume" :: waited 0.338s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Lock "cinder-quobyte-37044ef6-4a3e-4cb6-9c21-aac48b3eb774" released by "delete_volume" :: held 2.078s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:51 devstack cinder-volume[83206]: WARNING cinder.quota [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1729020440 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1729020440, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:35:51 devstack cinder-volume[83206]: WARNING cinder.quota [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1729020440 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1729020440, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:35:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-quobyte-b803bf01-aa67-42f7-b254-c9d86d17b600" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:51 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Created reservations ['b379161b-795d-4ab7-bfb6-969215ec8cfb', '83bc1e74-9219-4e24-94e6-54dd993569dc', 'bbf7592e-a39f-4c24-9861-5eb7690c27d0', 'd834b8f5-f0d9-4cdf-9d74-1184266dd61a'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:35:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-b803bf01-aa67-42f7-b254-c9d86d17b600" acquired by "delete_volume" :: waited 0.059s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674b80c-92ab-4107-aded-b13550a71f47]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.120s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.078s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600" returned: 0 in 1.815s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.575s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:53 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b803bf01-aa67-42f7-b254-c9d86d17b600" returned: 0 in 0.304s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Deleted volume successfully. Sep 10 13:35:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-b803bf01-aa67-42f7-b254-c9d86d17b600" released by "delete_volume" :: held 2.548s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b7991cd4-c779-44ad-afdf-73b394e34d06 tempest-VolumeTypesAccessTest-1211506086 None] Lock "cinder-37044ef6-4a3e-4cb6-9c21-aac48b3eb774-delete_volume" released by "delete_volume" :: held 5.369s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Created reservations ['6344242b-c718-4440-b3f4-82c1cb67973d', 'b2ca5bda-9c28-48c5-beef-24e0ddcc64bd', 'e5d41380-02f2-4715-8ae1-dd7c62266c20', '276b2060-d7f6-491a-8d7b-7e8e51a631e2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.165s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:54 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Deleted volume successfully. Sep 10 13:35:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ac754535-c9ec-4a97-8244-e6d8368f82e7 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-b803bf01-aa67-42f7-b254-c9d86d17b600-delete_volume" released by "delete_volume" :: held 4.065s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-78e7bcd8-c26c-438d-824b-5c9419cac9bb-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-78e7bcd8-c26c-438d-824b-5c9419cac9bb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-quobyte-78e7bcd8-c26c-438d-824b-5c9419cac9bb" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-78e7bcd8-c26c-438d-824b-5c9419cac9bb" acquired by "delete_volume" :: waited 0.029s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce904ef-2e04-4af0-aa48-66f840a7e711]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb" returned: 0 in 0.572s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-78e7bcd8-c26c-438d-824b-5c9419cac9bb" returned: 0 in 0.285s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-78e7bcd8-c26c-438d-824b-5c9419cac9bb" released by "delete_volume" :: held 1.100s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:57 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Created reservations ['05e0ce83-38be-471f-ba7e-0f9a64b64df5', 'd78de666-e920-45fd-87ca-8721890eed51', 'c4974668-fb78-4b48-9ebe-ed024d7988fe', '186bbd54-a7f0-4f2f-aaf6-bfd555fb6739'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:35:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:35:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:35:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:35:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:35:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:35:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-24116a4b-77a3-46c1-b1ed-b54c18bad662-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-24116a4b-77a3-46c1-b1ed-b54c18bad662-delete_volume" acquired by "delete_volume" :: waited 0.213s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.856s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:58 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:35:58 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Deleted volume successfully. Sep 10 13:35:58 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:35:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "cinder-quobyte-24116a4b-77a3-46c1-b1ed-b54c18bad662" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:35:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f129dc25-ac32-4c8d-bf9a-7fdde38cf8f6 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-78e7bcd8-c26c-438d-824b-5c9419cac9bb-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:35:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-24116a4b-77a3-46c1-b1ed-b54c18bad662" acquired by "delete_volume" :: waited 0.035s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:35:59 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f87fb3-b658-42f7-98c6-237a19f20c07]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:35:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662" returned: 0 in 0.727s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:35:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:35:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-24116a4b-77a3-46c1-b1ed-b54c18bad662" returned: 0 in 0.176s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-quobyte-24116a4b-77a3-46c1-b1ed-b54c18bad662" released by "delete_volume" :: held 1.137s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Created reservations ['201f1438-6cee-4821-a8a8-a49e49e59cf0', '73613bd1-500f-43ac-a0e2-a43665e8c3e2', 'ab41db5b-a6dc-498f-ae51-16bbb236653d', '07b60d05-232b-487c-949b-06251a41576d'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.150s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:00 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:01 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Deleted volume successfully. Sep 10 13:36:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1ece516-528f-4daa-b6cf-9a9ccfb9afe9 tempest-CreateVolumesFromImageTest-92917229 None] Lock "cinder-24116a4b-77a3-46c1-b1ed-b54c18bad662-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.316s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:15 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (108cfeb8-f9e1-404c-89e0-8a1ce992b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a1513d-fdf8-4d57-8c73-6f21ca700b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a1513d-fdf8-4d57-8c73-6f21ca700b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733367778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99b96ec-7315-4cf0-be58-6151f19ea8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:15Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e29c56-10a6-4a99-b369-b1c29ba84247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e29c56-10a6-4a99-b369-b1c29ba84247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ec489-7f82-422c-99b0-31f8569c41cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ec489-7f82-422c-99b0-31f8569c41cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99b96ec-7315-4cf0-be58-6151f19ea8d3', 'volume_name': 'volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8298498a-35dc-44c3-b79b-db7d31b622ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8298498a-35dc-44c3-b79b-db7d31b622ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f65d3f3-5f7a-4f03-add0-c4a5872fdb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:16 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume c99b96ec-7315-4cf0-be58-6151f19ea8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3', 'volume_size': 1} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733367778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99b96ec-7315-4cf0-be58-6151f19ea8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:15Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Creating volume c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:16 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:16 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=74, name=volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 1073741824" returned: 0 in 0.583s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3" returned: 0 in 0.147s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] <== create_volume: return (863ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f65d3f3-5f7a-4f03-add0-c4a5872fdb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f3cf02-d511-40cb-9273-05f458ae8b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:17 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 (c99b96ec-7315-4cf0-be58-6151f19ea8d3): created successfully Sep 10 13:36:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f3cf02-d511-40cb-9273-05f458ae8b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (108cfeb8-f9e1-404c-89e0-8a1ce992b596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:17 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d238deef-fbfb-4268-bdb0-bf1c289107b8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created volume successfully. Sep 10 13:36:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Creating offline snapshot 08c8b149-0b58-443c-9ecd-69607ec59254 of volume c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:36:18 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34bb9d-74bf-4a81-b1b8-3329bc373626]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3" returned: 0 in 0.701s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:19 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=75, name=volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 1G" returned: 0 in 0.439s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:20 devstack quobyte-client[83260]: System call of process 91870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img rebase -u -b volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254" returned: 0 in 0.282s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254" returned: 0 in 0.148s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254" returned: 0 in 0.134s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.info" returned: 0 in 0.176s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:36:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.info" returned: 0 in 0.338s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.760s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:21 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9c25ff90-d414-4a85-aa4e-c0a860366765 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Create snapshot completed successfully Sep 10 13:36:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (9a0dd2a8-6251-4e3c-ac6a-ef80fcff7554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dad4a68-a303-4df0-8675-085ab01b2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dad4a68-a303-4df0-8675-085ab01b2aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012396328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:24Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d2dcdf-8a86-4aa7-bac4-f8dfdc1240e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d2dcdf-8a86-4aa7-bac4-f8dfdc1240e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bc77de-925a-4dd2-b244-3a8e3fec3b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bc77de-925a-4dd2-b244-3a8e3fec3b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335', 'volume_name': 'volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d1c12c-e6ec-4d16-b8d9-d6453c1b7789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d1c12c-e6ec-4d16-b8d9-d6453c1b7789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004e938e-f1d5-4b54-a246-c37b0486c2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:24 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume 8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335', 'volume_size': 1} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012396328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:24Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Creating volume 8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:24 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:24 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=77, name=volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335 1073741824" returned: 0 in 0.886s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:26 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (adb89392-de01-45ab-b20c-36e0cce1ed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94a295b-2fb5-492c-8470-fa58cc1abb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94a295b-2fb5-492c-8470-fa58cc1abb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-327303134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fbc3a9-5668-4602-a733-367a54d81c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:25Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec564cc1-ea0f-40d3-be32-bdd5992e8b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec564cc1-ea0f-40d3-be32-bdd5992e8b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac474d4-e961-4076-9f59-c683feb48804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac474d4-e961-4076-9f59-c683feb48804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fbc3a9-5668-4602-a733-367a54d81c11', 'volume_name': 'volume-23fbc3a9-5668-4602-a733-367a54d81c11', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4908b8f9-9c1f-4099-bf45-3b8ba8592de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4908b8f9-9c1f-4099-bf45-3b8ba8592de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da20dec0-add0-488c-a479-e521f38d63a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:27 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume 23fbc3a9-5668-4602-a733-367a54d81c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fbc3a9-5668-4602-a733-367a54d81c11', 'volume_size': 1} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335" returned: 0 in 1.841s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] <== create_volume: return (2790ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.814s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-327303134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fbc3a9-5668-4602-a733-367a54d81c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:25Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Creating volume 23fbc3a9-5668-4602-a733-367a54d81c11 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:27 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:27 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=78, name=volume-23fbc3a9-5668-4602-a733-367a54d81c11, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004e938e-f1d5-4b54-a246-c37b0486c2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b07e53-a8be-436b-b12f-7b266a0ce601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:28 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:28 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (c02829b0-e44f-4d0a-a980-f1aad31e1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c02fc2-030f-4423-8f79-5b0f9f85227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11 1073741824" returned: 0 in 1.331s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c02fc2-030f-4423-8f79-5b0f9f85227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260083273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44792878-3930-418e-ae90-76a87b1f598f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:26Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1632d143-d62d-42a5-9840-950df11c2696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1632d143-d62d-42a5-9840-950df11c2696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4299d7e8-bee6-4e2d-81e6-b36c29538682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4299d7e8-bee6-4e2d-81e6-b36c29538682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44792878-3930-418e-ae90-76a87b1f598f', 'volume_name': 'volume-44792878-3930-418e-ae90-76a87b1f598f', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c79d19-dd68-4af9-850f-a9efacd0cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c79d19-dd68-4af9-850f-a9efacd0cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b712fd1-7fc9-4cdb-a99c-8bed2f296884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume 44792878-3930-418e-ae90-76a87b1f598f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44792878-3930-418e-ae90-76a87b1f598f', 'volume_size': 1} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:29 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335 (8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335): created successfully Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b07e53-a8be-436b-b12f-7b266a0ce601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (9a0dd2a8-6251-4e3c-ac6a-ef80fcff7554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:29 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (1d1894d9-8a3a-4e25-aef7-f5cbf106c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea4578a-b0b2-4a98-a21a-e9c9529e182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (6933d23e-a44c-4085-8b3f-b048ec15423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7657bb0d-0e02-461f-b868-55bd6dfb5f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11" returned: 0 in 0.856s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] <== create_volume: return (2212ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea4578a-b0b2-4a98-a21a-e9c9529e182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1275734472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36483a6c-c8a2-486d-9b21-ec7cd1c3da32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:27Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0f62a8-b1f7-42ad-b4d9-d1a878e7b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0f62a8-b1f7-42ad-b4d9-d1a878e7b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb7efdf-1183-477d-b4b2-f11259c74492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb7efdf-1183-477d-b4b2-f11259c74492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36483a6c-c8a2-486d-9b21-ec7cd1c3da32', 'volume_name': 'volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf1d768-9666-4386-9ac1-8a1c525208ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf1d768-9666-4386-9ac1-8a1c525208ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea5aee7-8f5e-4b46-b597-d8f8a7c73fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:29 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume 36483a6c-c8a2-486d-9b21-ec7cd1c3da32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32', 'volume_size': 1} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1275734472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36483a6c-c8a2-486d-9b21-ec7cd1c3da32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:27Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Creating volume 36483a6c-c8a2-486d-9b21-ec7cd1c3da32 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:29 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:29 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=79, name=volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:30 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-382fe9fd-ae39-409f-af40-da932817decb tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created volume successfully. Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=79,cinder:SELECT=49,cinder:DELETE=4,cinder:INSERT=17 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7657bb0d-0e02-461f-b868-55bd6dfb5f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-92116345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f759ae-6467-4b58-97df-6e301a3b642e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:28Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86632993-54ce-4371-b65d-668c6d5c5d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86632993-54ce-4371-b65d-668c6d5c5d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6f723b-66b4-4fc4-b7e7-c6cdbc7ccbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6f723b-66b4-4fc4-b7e7-c6cdbc7ccbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f759ae-6467-4b58-97df-6e301a3b642e', 'volume_name': 'volume-b3f759ae-6467-4b58-97df-6e301a3b642e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41dc5f01-6763-4708-b7da-a91738df55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41dc5f01-6763-4708-b7da-a91738df55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e72005-331c-4e6d-89ef-d278fed6e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:30 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume b3f759ae-6467-4b58-97df-6e301a3b642e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f759ae-6467-4b58-97df-6e301a3b642e', 'volume_size': 1} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da20dec0-add0-488c-a479-e521f38d63a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fbc3a9-5668-4602-a733-367a54d81c11', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293b05f3-545d-4f0d-9aaf-6c88dc4cb3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32 1073741824" returned: 0 in 0.700s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-ff1f316b-d1db-4214-bbf4-cee945801e82 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:30 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume volume-23fbc3a9-5668-4602-a733-367a54d81c11 (23fbc3a9-5668-4602-a733-367a54d81c11): created successfully Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293b05f3-545d-4f0d-9aaf-6c88dc4cb3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (adb89392-de01-45ab-b20c-36e0cce1ed20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32" returned: 0 in 0.464s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] <== create_volume: return (1205ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260083273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44792878-3930-418e-ae90-76a87b1f598f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:26Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Creating volume 44792878-3930-418e-ae90-76a87b1f598f {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:30 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=40,cinder:UPDATE=59,cinder:DELETE=11,cinder:INSERT=7 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:36:31 devstack quobyte-client[83260]: System call of process 91896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:36:31 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=80, name=volume-44792878-3930-418e-ae90-76a87b1f598f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-41c4b510-2732-4674-81f8-f3c5dd8f73d7 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created volume successfully. Sep 10 13:36:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-ff1f316b-d1db-4214-bbf4-cee945801e82 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-ff1f316b-d1db-4214-bbf4-cee945801e82 tempest-TaggedBootDevicesTest-1645062834 None] Terminate volume connection completed successfully. Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-ff1f316b-d1db-4214-bbf4-cee945801e82 tempest-TaggedBootDevicesTest-1645062834 None] Deleting attachment bde6ff03-ab68-438b-b540-ea87f9c786f5. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea5aee7-8f5e-4b46-b597-d8f8a7c73fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bf5308-3400-4fb5-a22d-a75bb6726c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f 1073741824" returned: 0 in 0.618s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:31 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32 (36483a6c-c8a2-486d-9b21-ec7cd1c3da32): created successfully Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bf5308-3400-4fb5-a22d-a75bb6726c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (1d1894d9-8a3a-4e25-aef7-f5cbf106c47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:32 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-64662229-7b99-48a8-85d1-fc2dad6d9a39 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-706204a8-b8d3-4094-a61a-2d687a0140b6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created volume successfully. Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f" returned: 0 in 0.541s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] <== create_volume: return (1179ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.747s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-92116345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f759ae-6467-4b58-97df-6e301a3b642e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43325f191b374799a2f80c2d39afd3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:28Z,use_quota=True,user_id='34e914de86cf447ab11985b48dac81b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Creating volume b3f759ae-6467-4b58-97df-6e301a3b642e {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:32 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:32 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=81, name=volume-b3f759ae-6467-4b58-97df-6e301a3b642e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:32 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-64662229-7b99-48a8-85d1-fc2dad6d9a39 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-64662229-7b99-48a8-85d1-fc2dad6d9a39 tempest-TaggedBootDevicesTest-1645062834 None] Terminate volume connection completed successfully. Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-64662229-7b99-48a8-85d1-fc2dad6d9a39 tempest-TaggedBootDevicesTest-1645062834 None] Deleting attachment d2a3be1d-703c-429f-8196-dcb32c9794b8. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b712fd1-7fc9-4cdb-a99c-8bed2f296884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44792878-3930-418e-ae90-76a87b1f598f', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e73fd6-251a-43e0-830c-fe2deae2f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e 1073741824" returned: 0 in 0.557s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e" returned: 0 in 0.233s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] <== create_volume: return (832ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:33 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume volume-44792878-3930-418e-ae90-76a87b1f598f (44792878-3930-418e-ae90-76a87b1f598f): created successfully Sep 10 13:36:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e73fd6-251a-43e0-830c-fe2deae2f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (c02829b0-e44f-4d0a-a980-f1aad31e1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-6ed68b92-078d-4663-ab3c-faec50d12196 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e72005-331c-4e6d-89ef-d278fed6e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f759ae-6467-4b58-97df-6e301a3b642e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ac3c74-1405-4e67-ab9c-949c0243b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-6ed68b92-078d-4663-ab3c-faec50d12196 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:33 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-6ed68b92-078d-4663-ab3c-faec50d12196 tempest-TaggedBootDevicesTest-1645062834 None] Terminate volume connection completed successfully. Sep 10 13:36:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-d3ac85e7-5750-4fb9-b766-609f05edf570 req-6ed68b92-078d-4663-ab3c-faec50d12196 tempest-TaggedBootDevicesTest-1645062834 None] Deleting attachment e3565ca2-050d-427d-b4a5-92958cf67279. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:36:33 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-beff4c02-ea47-42b4-ae51-6bb0e34c002f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created volume successfully. Sep 10 13:36:33 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume volume-b3f759ae-6467-4b58-97df-6e301a3b642e (b3f759ae-6467-4b58-97df-6e301a3b642e): created successfully Sep 10 13:36:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ac3c74-1405-4e67-ab9c-949c0243b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Flow 'volume_create_manager' (6933d23e-a44c-4085-8b3f-b048ec15423b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:33 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8cfbf6a5-ad75-4544-9cef-002f889d7402 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created volume successfully. Sep 10 13:36:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-b3f759ae-6467-4b58-97df-6e301a3b642e-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-b3f759ae-6467-4b58-97df-6e301a3b642e-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:34 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-b3f759ae-6467-4b58-97df-6e301a3b642e" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-b3f759ae-6467-4b58-97df-6e301a3b642e" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:34 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[95761a42-3f8d-4f86-9c81-9032eb5114bc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e" returned: 0 in 0.538s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b3f759ae-6467-4b58-97df-6e301a3b642e" returned: 0 in 0.113s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-b3f759ae-6467-4b58-97df-6e301a3b642e" released by "delete_volume" :: held 0.818s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:35 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created reservations ['575e6ff9-259c-4239-a0c4-6dc1fa7faab8', '9a4b8e29-1506-47f2-ae7d-68ccbb1bc3b0', 'd0a38de3-3cb4-41c5-a1d2-7f0b40b5c350', '1a488920-f4e2-4051-8721-d3bd8d998911'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.164s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Deleted volume successfully. Sep 10 13:36:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e9bddea1-6784-4f77-81ec-bf31e89e0375 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-b3f759ae-6467-4b58-97df-6e301a3b642e-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-36483a6c-c8a2-486d-9b21-ec7cd1c3da32-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-36483a6c-c8a2-486d-9b21-ec7cd1c3da32-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-36483a6c-c8a2-486d-9b21-ec7cd1c3da32" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-36483a6c-c8a2-486d-9b21-ec7cd1c3da32" acquired by "delete_volume" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:37 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a1518-68e4-4083-9fbd-fc90306030ed]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:37 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Flow 'volume_create_manager' (589c69df-3e71-40ff-bcf1-878c72255387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b9368f-f3a8-47ff-a65f-5e1da2db6e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32" returned: 0 in 0.772s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b9368f-f3a8-47ff-a65f-5e1da2db6e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1343922114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74c584a-2427-4a88-bf1a-f64db2213f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9db2d1157a1448889970b44b3a93be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:38Z,use_quota=True,user_id='a922cbb697104f27b3a620ad399b34e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31db3e5f-930d-4cf1-af6a-081f09136d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31db3e5f-930d-4cf1-af6a-081f09136d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dafbcf7-d986-4151-a58b-5498c9f7c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dafbcf7-d986-4151-a58b-5498c9f7c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74c584a-2427-4a88-bf1a-f64db2213f60', 'volume_name': 'volume-a74c584a-2427-4a88-bf1a-f64db2213f60', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec347ff-224b-413e-b1a4-7e5f704ee98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec347ff-224b-413e-b1a4-7e5f704ee98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836d2926-e19f-4ab7-b016-9361d9831c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:38 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Volume a74c584a-2427-4a88-bf1a-f64db2213f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74c584a-2427-4a88-bf1a-f64db2213f60', 'volume_size': 1} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1343922114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74c584a-2427-4a88-bf1a-f64db2213f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9db2d1157a1448889970b44b3a93be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:38Z,use_quota=True,user_id='a922cbb697104f27b3a620ad399b34e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Creating volume a74c584a-2427-4a88-bf1a-f64db2213f60 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:38 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36483a6c-c8a2-486d-9b21-ec7cd1c3da32" returned: 0 in 0.568s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:38 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=82, name=volume-a74c584a-2427-4a88-bf1a-f64db2213f60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-36483a6c-c8a2-486d-9b21-ec7cd1c3da32" released by "delete_volume" :: held 1.551s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60 1073741824" returned: 0 in 0.515s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60" returned: 0 in 0.283s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] <== create_volume: return (841ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created reservations ['0dee07ef-4b28-4dbe-acd6-fe1f2c65ec82', 'cbe21ac0-7ce8-4346-a75a-c64e14bb175d', '4e0068f9-8a43-44a9-9e1d-2095cb238ba5', '8615df0e-76e8-49b9-b416-28925045f57e'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836d2926-e19f-4ab7-b016-9361d9831c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74c584a-2427-4a88-bf1a-f64db2213f60', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e858e28-6e51-4846-9d4b-3ac6aa2d2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:39 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Volume volume-a74c584a-2427-4a88-bf1a-f64db2213f60 (a74c584a-2427-4a88-bf1a-f64db2213f60): created successfully Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e858e28-6e51-4846-9d4b-3ac6aa2d2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Flow 'volume_create_manager' (589c69df-3e71-40ff-bcf1-878c72255387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:39 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4ae6a07c-02ed-41ed-b148-ff303b1cdcae tempest-VolumesListAdminTestJSON-1984796270 None] Created volume successfully. Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.172s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:40 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:40 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Deleted volume successfully. Sep 10 13:36:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-afab1034-37a1-4462-a2d2-93ae2b250def tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-36483a6c-c8a2-486d-9b21-ec7cd1c3da32-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-44792878-3930-418e-ae90-76a87b1f598f-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-44792878-3930-418e-ae90-76a87b1f598f-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:41 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-44792878-3930-418e-ae90-76a87b1f598f" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-44792878-3930-418e-ae90-76a87b1f598f" acquired by "delete_volume" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:41 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab34cdc3-5b59-45e1-aafe-c63b47f88e13]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f" returned: 0 in 0.838s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-44792878-3930-418e-ae90-76a87b1f598f" returned: 0 in 0.135s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-44792878-3930-418e-ae90-76a87b1f598f" released by "delete_volume" :: held 1.131s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:43 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created reservations ['3ca1363a-170a-4b65-9f1f-174d7a7297c6', '19d3b9e5-7cc4-4a0e-9095-c0a43c49076f', 'e5bc55a7-8cbb-48b5-800e-c688c587abee', '845c1980-b97b-44ae-8beb-052c3cddc29f'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:43 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:43 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Flow 'volume_create_manager' (41fb3a0e-c2ba-46bb-844f-512f5f953780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46685c0b-2c37-44e1-95e9-1f554b4d29f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46685c0b-2c37-44e1-95e9-1f554b4d29f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1102123263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3548a5-815c-42a6-8624-a6cd7e8c60f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9db2d1157a1448889970b44b3a93be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:43Z,use_quota=True,user_id='a922cbb697104f27b3a620ad399b34e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0befda97-7968-4f3b-aedb-ec1e1b2777fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0befda97-7968-4f3b-aedb-ec1e1b2777fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd28a227-0671-4a1b-a70c-e59dfe128d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd28a227-0671-4a1b-a70c-e59dfe128d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f3548a5-815c-42a6-8624-a6cd7e8c60f6', 'volume_name': 'volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14e174b-ce3c-47f7-a501-b9b31d962ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14e174b-ce3c-47f7-a501-b9b31d962ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcf98d3-40bf-4eb6-a68a-6818ca98a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:44 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Volume 3f3548a5-815c-42a6-8624-a6cd7e8c60f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6', 'volume_size': 1} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1102123263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3548a5-815c-42a6-8624-a6cd7e8c60f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9db2d1157a1448889970b44b3a93be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:43Z,use_quota=True,user_id='a922cbb697104f27b3a620ad399b34e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Creating volume 3f3548a5-815c-42a6-8624-a6cd7e8c60f6 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:44 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:44 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=83, name=volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-23fbc3a9-5668-4602-a733-367a54d81c11-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6 1073741824" returned: 0 in 0.850s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-23fbc3a9-5668-4602-a733-367a54d81c11-delete_volume" acquired by "delete_volume" :: waited 0.558s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.546s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:45 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Deleted volume successfully. Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6" returned: 0 in 0.589s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] <== create_volume: return (1483ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcf98d3-40bf-4eb6-a68a-6818ca98a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f70a89-393d-436e-8c8d-38cc353ea86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-909e5065-cf18-4835-9671-dc1def4970f9 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-44792878-3930-418e-ae90-76a87b1f598f-delete_volume" released by "delete_volume" :: held 5.123s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:45 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Volume volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6 (3f3548a5-815c-42a6-8624-a6cd7e8c60f6): created successfully Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f70a89-393d-436e-8c8d-38cc353ea86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Flow 'volume_create_manager' (41fb3a0e-c2ba-46bb-844f-512f5f953780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:45 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-23fbc3a9-5668-4602-a733-367a54d81c11" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "cinder-2e0778f4-49cc-4d95-8757-7a22ed424e89-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:45 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8e320d7b-8f43-44ac-9af8-3524878aca95 tempest-VolumesListAdminTestJSON-1984796270 None] Created volume successfully. Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-23fbc3a9-5668-4602-a733-367a54d81c11" acquired by "delete_volume" :: waited 0.048s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[243874ab-bb23-4189-bba1-54ff5eee8aed]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-2e0778f4-49cc-4d95-8757-7a22ed424e89-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "cinder-quobyte-2e0778f4-49cc-4d95-8757-7a22ed424e89" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-quobyte-2e0778f4-49cc-4d95-8757-7a22ed424e89" acquired by "delete_volume" :: waited 0.046s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65861d7-f55b-4350-8810-ed9724f834db]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11" returned: 0 in 0.710s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-23fbc3a9-5668-4602-a733-367a54d81c11" returned: 0 in 0.183s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-23fbc3a9-5668-4602-a733-367a54d81c11" released by "delete_volume" :: held 1.144s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89" returned: 0 in 0.706s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2e0778f4-49cc-4d95-8757-7a22ed424e89" returned: 0 in 0.433s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-quobyte-2e0778f4-49cc-4d95-8757-7a22ed424e89" released by "delete_volume" :: held 1.281s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:47 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created reservations ['b4c60911-c7bb-457e-ad9b-6e894d5454c2', 'd85f1e91-6dea-4847-a225-81f00343684d', '756dcbd8-ddca-4c1f-a1d3-9b128a3897c1', '9869ec87-8aac-453b-8ce8-8fe68bb830a2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:47 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Flow 'volume_create_manager' (ab15c0a4-8689-4009-ba3a-f44d1ea4d464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419a6831-eb8b-4537-af87-b351da26b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419a6831-eb8b-4537-af87-b351da26b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-396847602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e5f640-198a-491a-8c67-23b63ed972a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9db2d1157a1448889970b44b3a93be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:48Z,use_quota=True,user_id='a922cbb697104f27b3a620ad399b34e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c717498d-d399-4742-bd83-0e41b177d749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c717498d-d399-4742-bd83-0e41b177d749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575d930a-1803-4d22-9dd8-d24f32c208cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575d930a-1803-4d22-9dd8-d24f32c208cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e5f640-198a-491a-8c67-23b63ed972a8', 'volume_name': 'volume-c1e5f640-198a-491a-8c67-23b63ed972a8', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fbf6a0-575d-423a-a840-6a964c498345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fbf6a0-575d-423a-a840-6a964c498345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e114318e-db26-436e-943f-2e11463dfc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Volume c1e5f640-198a-491a-8c67-23b63ed972a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e5f640-198a-491a-8c67-23b63ed972a8', 'volume_size': 1} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-396847602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e5f640-198a-491a-8c67-23b63ed972a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9db2d1157a1448889970b44b3a93be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:48Z,use_quota=True,user_id='a922cbb697104f27b3a620ad399b34e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Creating volume c1e5f640-198a-491a-8c67-23b63ed972a8 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:48 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Created reservations ['ebe8c475-bbc1-40b7-83ed-1e7f762acaf7', '2f10dee9-7bdf-452f-92ad-4fdcfd7dd97c', 'e558f9dc-b3ff-4d7d-974c-a5922cf911de', 'ec90fb12-eb32-488d-9549-e91304407404'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:48 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=84, name=volume-c1e5f640-198a-491a-8c67-23b63ed972a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8 1073741824" returned: 0 in 0.459s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8" returned: 0 in 0.358s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] <== create_volume: return (849ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e114318e-db26-436e-943f-2e11463dfc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e5f640-198a-491a-8c67-23b63ed972a8', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e90515-0d18-4d7c-9f1b-f0692e36e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:49 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Volume volume-c1e5f640-198a-491a-8c67-23b63ed972a8 (c1e5f640-198a-491a-8c67-23b63ed972a8): created successfully Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e90515-0d18-4d7c-9f1b-f0692e36e878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Flow 'volume_create_manager' (ab15c0a4-8689-4009-ba3a-f44d1ea4d464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "cinder-0d6ce55d-5a86-4dfe-9958-e7beaee660d9-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:49 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9910c7bb-9bff-4953-b6dd-9fbf1e00637b tempest-VolumesListAdminTestJSON-1984796270 None] Created volume successfully. Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335" acquired by "delete_volume" :: waited 0.502s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.500s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-0d6ce55d-5a86-4dfe-9958-e7beaee660d9-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3862a7d8-64d3-48b2-99ce-95120b1a64d2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.044s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Deleted volume successfully. Sep 10 13:36:50 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "cinder-quobyte-0d6ce55d-5a86-4dfe-9958-e7beaee660d9" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.544s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335" returned: 0 in 0.933s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-4ce84359-3827-4b27-9436-5fd8cbada108 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-2e0778f4-49cc-4d95-8757-7a22ed424e89-delete_volume" released by "delete_volume" :: held 4.789s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Deleted volume successfully. Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-quobyte-0d6ce55d-5a86-4dfe-9958-e7beaee660d9" acquired by "delete_volume" :: waited 0.546s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335" returned: 0 in 0.485s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aa2a768-2982-4aa8-87e2-9c32cbf2eeb6 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-23fbc3a9-5668-4602-a733-367a54d81c11-delete_volume" released by "delete_volume" :: held 6.177s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a3200-1282-46e2-9e5e-d52aaf9eee34]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335" released by "delete_volume" :: held 1.704s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Flow 'volume_create_manager' (ea319b42-261b-4cef-9f46-21b7220df65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f5d3b6-3320-42c5-9188-13a3af001ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f5d3b6-3320-42c5-9188-13a3af001ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4377fb1a-b3d5-414d-8e38-9cbc5388dff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7da7f770894ffcb8f32f395cd56d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:51Z,use_quota=True,user_id='6a748a760bb44fdc9091a5ccfe0eff54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8191ddbe-2abf-419f-9c44-79e871b1c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8191ddbe-2abf-419f-9c44-79e871b1c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8576e05-2fd7-421b-85fa-e72bef0be9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8576e05-2fd7-421b-85fa-e72bef0be9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4377fb1a-b3d5-414d-8e38-9cbc5388dff6', 'volume_name': 'volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d441a-922e-45a3-a0b6-b433b7dc5fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d441a-922e-45a3-a0b6-b433b7dc5fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b173756-0e7b-4d06-b474-01381da325b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:51 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Volume 4377fb1a-b3d5-414d-8e38-9cbc5388dff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6', 'volume_size': 1} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4377fb1a-b3d5-414d-8e38-9cbc5388dff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7da7f770894ffcb8f32f395cd56d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:51Z,use_quota=True,user_id='6a748a760bb44fdc9091a5ccfe0eff54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Creating volume 4377fb1a-b3d5-414d-8e38-9cbc5388dff6 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:36:51 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:36:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:52 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=85, name=volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9" returned: 0 in 0.907s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6 1073741824" returned: 0 in 0.595s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0d6ce55d-5a86-4dfe-9958-e7beaee660d9" returned: 0 in 0.339s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6" returned: 0 in 0.359s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] <== create_volume: return (992ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-quobyte-0d6ce55d-5a86-4dfe-9958-e7beaee660d9" released by "delete_volume" :: held 1.694s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:52 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created reservations ['25e98d36-4278-4cf5-9ad5-0a75773013d3', '4eb1fdea-c84d-4a4f-8607-61413d9d50a0', '89e1a0ad-0d3e-4aac-8b9c-7ea544598dab', '8a22f1dd-5d6d-4b39-896d-350e54e970c9'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b173756-0e7b-4d06-b474-01381da325b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441d7522-a025-4e47-9375-b6e275e5fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:36:53 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Volume volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6 (4377fb1a-b3d5-414d-8e38-9cbc5388dff6): created successfully Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441d7522-a025-4e47-9375-b6e275e5fe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Flow 'volume_create_manager' (ea319b42-261b-4cef-9f46-21b7220df65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Created reservations ['848fe267-086e-4916-8689-8a301f519409', 'd6d82eac-a1d4-42e4-a2fd-bfe2b8914876', '877e3ea0-fc76-4f81-a526-71f33b953e48', '885f07d2-4886-4cf5-9f01-90e6ecc3378d'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5f9c7004-c459-40ad-bf77-f7de67d7b6fa tempest-VolumesListAdminTestJSON-676544637 None] Created volume successfully. Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-08c8b149-0b58-443c-9ecd-69607ec59254-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.423s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Deleted volume successfully. Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-08c8b149-0b58-443c-9ecd-69607ec59254-delete_snapshot" acquired by "delete_snapshot" :: waited 0.145s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:53 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-c99b96ec-7315-4cf0-be58-6151f19ea8d3" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-06b1c3b5-dd33-4126-b632-cdddb76e8dd8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-8c68a5b7-ca7d-4c1a-b9a7-a10f03da2335-delete_volume" released by "delete_volume" :: held 4.696s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-c99b96ec-7315-4cf0-be58-6151f19ea8d3" acquired by "delete_snapshot" :: waited 0.178s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-08c8b149-0b58-443c-9ecd-69607ec59254" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "cinder-b35f9579-8a87-4637-abb3-509e219ff708-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.301s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Deleted volume successfully. Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-08c8b149-0b58-443c-9ecd-69607ec59254" acquired by "_delete_snapshot" :: waited 0.298s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Deleting offline snapshot 08c8b149-0b58-443c-9ecd-69607ec59254 of volume c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] snapshot_file for this snap is: volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca3102b-bf6e-47fb-b462-a8a6b7311f30]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-b35f9579-8a87-4637-abb3-509e219ff708-delete_volume" acquired by "delete_volume" :: waited 0.407s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Acquiring lock "cinder-4377fb1a-b3d5-414d-8e38-9cbc5388dff6-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "cinder-c1e5f640-198a-491a-8c67-23b63ed972a8-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:54 devstack quobyte-client[83260]: System call of process 91996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c59377f7-2cfe-4768-8ec1-6c6a638d93c8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-0d6ce55d-5a86-4dfe-9958-e7beaee660d9-delete_volume" released by "delete_volume" :: held 5.212s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254" returned: 0 in 0.669s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Lock "cinder-4377fb1a-b3d5-414d-8e38-9cbc5388dff6-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-c1e5f640-198a-491a-8c67-23b63ed972a8-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53d42f2-a3b9-4c80-9254-844b29f2f53b]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "cinder-quobyte-b35f9579-8a87-4637-abb3-509e219ff708" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Acquiring lock "cinder-quobyte-4377fb1a-b3d5-414d-8e38-9cbc5388dff6" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-quobyte-b35f9579-8a87-4637-abb3-509e219ff708" acquired by "delete_volume" :: waited 0.105s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "cinder-quobyte-c1e5f640-198a-491a-8c67-23b63ed972a8" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Lock "cinder-quobyte-4377fb1a-b3d5-414d-8e38-9cbc5388dff6" acquired by "delete_volume" :: waited 0.060s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-quobyte-c1e5f640-198a-491a-8c67-23b63ed972a8" acquired by "delete_volume" :: waited 0.051s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c648d6-8f5f-4c9d-a578-a8db202dc454]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f5eb72-18e8-4289-8e9a-c5e2689ccfbb]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f773745-0c6c-4a9f-aa0b-53d891e1eb4f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3" returned: 0 in 1.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:56 devstack quobyte-client[83260]: System call of process 92007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6" returned: 0 in 0.730s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 0 in 0.767s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:56 devstack quobyte-client[83260]: System call of process 92006 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4377fb1a-b3d5-414d-8e38-9cbc5388dff6" returned: 0 in 0.370s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254" returned: 0 in 0.694s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8" returned: 0 in 1.182s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Lock "cinder-quobyte-4377fb1a-b3d5-414d-8e38-9cbc5388dff6" released by "delete_volume" :: held 1.600s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3.08c8b149-0b58-443c-9ecd-69607ec59254" returned: 0 in 0.553s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c1e5f640-198a-491a-8c67-23b63ed972a8" returned: 0 in 0.411s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 1 in 0.912s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-08c8b149-0b58-443c-9ecd-69607ec59254" released by "_delete_snapshot" :: held 3.276s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-quobyte-c1e5f640-198a-491a-8c67-23b63ed972a8" released by "delete_volume" :: held 2.091s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-c99b96ec-7315-4cf0-be58-6151f19ea8d3" released by "delete_snapshot" :: held 3.949s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b35f9579-8a87-4637-abb3-509e219ff708" returned: 0 in 0.420s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-quobyte-b35f9579-8a87-4637-abb3-509e219ff708" released by "delete_volume" :: held 2.494s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Created reservations ['5583f085-02e0-4a63-9027-9f4a86d1477c', 'bcd655a2-a7d5-49c1-b01b-adf0db96dc08', '6aa55ab6-34ad-4978-acce-6ab6ac7c1737', '7414ee53-6fec-414a-bd70-43cdfac98d1c'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Created reservations ['77849cb9-e389-413e-a057-d3a695019e43', 'eca0b244-a868-4f3c-afdf-8efe4ae3f416', '6c1e49d5-d1c1-4ff8-b277-40a01a07f206', 'f3d90272-8dcc-406d-890c-a322993dcdac'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created reservations ['ffdc6e25-db43-438e-b7ba-e8ed6a3f0533', 'e1abe20e-c864-4601-bb9c-ab47d1aa8463', 'a645c339-a393-4bd4-a0fc-e11977afef04', 'df79d899-558d-4fd8-9df9-f8c30efde332'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.317s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:58 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Deleted volume successfully. Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Created reservations ['c8880e48-c13e-489b-a182-da321cca114f', 'e17ba15f-2eec-44a7-85cd-003324ae753b', '22440701-3ffd-4fdb-841c-2dc38624681c', '92681bad-0564-41dd-a2dd-3190e35d2293'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:36:58 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Delete snapshot completed successfully. Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-95fc0fae-9651-4f04-af66-e81b051f59ae tempest-VolumesListAdminTestJSON-676544637 None] Lock "cinder-4377fb1a-b3d5-414d-8e38-9cbc5388dff6-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-751f676c-8af5-4ea7-b7d6-d092e752c4a8 tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-08c8b149-0b58-443c-9ecd-69607ec59254-delete_snapshot" released by "delete_snapshot" :: held 5.137s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-c99b96ec-7315-4cf0-be58-6151f19ea8d3-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.398s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:36:59 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Deleted volume successfully. Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-c99b96ec-7315-4cf0-be58-6151f19ea8d3-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "cinder-3f3548a5-815c-42a6-8624-a6cd7e8c60f6-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:36:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.448s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-79ed2ce9-6db2-4813-90bb-72005e830650 tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-c1e5f640-198a-491a-8c67-23b63ed972a8-delete_volume" released by "delete_volume" :: held 5.016s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Deleted volume successfully. Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-3f3548a5-815c-42a6-8624-a6cd7e8c60f6-delete_volume" acquired by "delete_volume" :: waited 0.197s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c5e9d14c-8e08-49eb-a033-63527e168ca8 tempest-TaggedBootDevicesTest-1645062834 None] Lock "cinder-b35f9579-8a87-4637-abb3-509e219ff708-delete_volume" released by "delete_volume" :: held 5.662s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "cinder-quobyte-c99b96ec-7315-4cf0-be58-6151f19ea8d3" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-c99b96ec-7315-4cf0-be58-6151f19ea8d3" acquired by "delete_volume" :: waited 0.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1402ed-6196-4239-b11c-d712eb722393]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "cinder-quobyte-3f3548a5-815c-42a6-8624-a6cd7e8c60f6" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-quobyte-3f3548a5-815c-42a6-8624-a6cd7e8c60f6" acquired by "delete_volume" :: waited 0.053s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf6a097-a4c2-491e-8904-f6d3d95719f3]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3" returned: 0 in 0.740s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-c99b96ec-7315-4cf0-be58-6151f19ea8d3" returned: 0 in 0.125s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-quobyte-c99b96ec-7315-4cf0-be58-6151f19ea8d3" released by "delete_volume" :: held 1.121s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:01 devstack quobyte-client[83260]: System call of process 92027 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:01 devstack quobyte-client[83260]: System call of process 92027 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6" returned: 0 in 0.788s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3f3548a5-815c-42a6-8624-a6cd7e8c60f6" returned: 0 in 0.277s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-quobyte-3f3548a5-815c-42a6-8624-a6cd7e8c60f6" released by "delete_volume" :: held 1.190s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Created reservations ['159415ae-e177-46a1-a016-fb88a82b26ac', '326d4cc0-bd3e-4069-afd3-f41096c719d5', '198a6630-ad00-4c32-80bb-7195aa83578a', '6eecd9b5-b5de-4983-8ad0-cca901b46664'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Created reservations ['3b9c6670-32bb-4a80-b61c-8aa761d30fa3', '579b4517-fa6c-439b-8954-6b35875a749e', '4842c21b-a042-48be-828a-df71f8bd9363', '3a785142-1b40-46c7-9119-4864bc622bc2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.474s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:02 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:03 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Deleted volume successfully. Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.419s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:03 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Deleted volume successfully. Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2102e2ec-c335-440c-a1a8-b1048965e2ed tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-3f3548a5-815c-42a6-8624-a6cd7e8c60f6-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-33264cfe-e188-4ef9-a50a-6b6fb790711f tempest-CreateVolumesFromSnapshotTest-1271524458 None] Lock "cinder-c99b96ec-7315-4cf0-be58-6151f19ea8d3-delete_volume" released by "delete_volume" :: held 3.843s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "cinder-a74c584a-2427-4a88-bf1a-f64db2213f60-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-a74c584a-2427-4a88-bf1a-f64db2213f60-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:03 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "cinder-quobyte-a74c584a-2427-4a88-bf1a-f64db2213f60" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-quobyte-a74c584a-2427-4a88-bf1a-f64db2213f60" acquired by "delete_volume" :: waited 0.035s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef79391f-c5e8-43fe-9c58-e4e92e0c6793]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60" returned: 0 in 1.094s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a74c584a-2427-4a88-bf1a-f64db2213f60" returned: 0 in 0.178s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-quobyte-a74c584a-2427-4a88-bf1a-f64db2213f60" released by "delete_volume" :: held 1.592s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:05 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Created reservations ['2b2b4168-a912-4b20-b3e9-715c9de0ee5e', '08f630d3-2f15-4fa3-95b0-3737775f9f65', 'c218cb83-3dde-4367-a76a-6c8169812731', 'dbe8741b-e0e6-40d0-a931-b4cd213bdac0'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.116s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Deleted volume successfully. Sep 10 13:37:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c1a08202-99e6-4064-a62c-8cee873204ca tempest-VolumesListAdminTestJSON-1984796270 None] Lock "cinder-a74c584a-2427-4a88-bf1a-f64db2213f60-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.185s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:13 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Flow 'volume_create_manager' (db3c2fdd-30bd-4ce5-acbd-ab4a09d12e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36542b0-edf8-40b6-8ec5-ef6b4b4d97d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36542b0-edf8-40b6-8ec5-ef6b4b4d97d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53618585-0224-46e3-94f7-b8796805894d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c525ff3a264b6a85028aa32ecaa040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:12Z,use_quota=True,user_id='4b4fd10da6354fc28e07d873b27e43d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda5242b-9ea2-4bbe-9810-36a38dfd9c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda5242b-9ea2-4bbe-9810-36a38dfd9c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ef1c2d-ed86-4a0f-97dd-0ea4ac2caff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ef1c2d-ed86-4a0f-97dd-0ea4ac2caff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53618585-0224-46e3-94f7-b8796805894d', 'volume_name': 'volume-53618585-0224-46e3-94f7-b8796805894d', 'volume_size': 1, 'image_id': '2b9c46c4-9208-4502-bc57-17459c8a9fd2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fd8fab5193eb3bc7803358fb5609cc1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35c525ff3a264b6a85028aa32ecaa040', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '297841e283f639924723c86c1874bf71e4a70a60a4f1b4100ac2f7dfd95e8fac327dcdcc5828ce2e488477a1a3f18462a486352ef2f0fa4c0c8b8f736cdfd89c', 'id': '2b9c46c4-9208-4502-bc57-17459c8a9fd2', 'created_at': datetime.datetime(2025, 9, 10, 11, 37, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 37, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b9c46c4-9208-4502-bc57-17459c8a9fd2/file', 'properties': {}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89521c7-13b0-4504-8d89-2e0be1d94ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89521c7-13b0-4504-8d89-2e0be1d94ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c40e42-2d98-4450-8fe5-5ae154730688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:13 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Volume 53618585-0224-46e3-94f7-b8796805894d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53618585-0224-46e3-94f7-b8796805894d', 'volume_size': 1, 'image_id': '2b9c46c4-9208-4502-bc57-17459c8a9fd2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fd8fab5193eb3bc7803358fb5609cc1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35c525ff3a264b6a85028aa32ecaa040', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '297841e283f639924723c86c1874bf71e4a70a60a4f1b4100ac2f7dfd95e8fac327dcdcc5828ce2e488477a1a3f18462a486352ef2f0fa4c0c8b8f736cdfd89c', 'id': '2b9c46c4-9208-4502-bc57-17459c8a9fd2', 'created_at': datetime.datetime(2025, 9, 10, 11, 37, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 37, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b9c46c4-9208-4502-bc57-17459c8a9fd2/file', 'properties': {}}, 'image_service': } Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Cloning 53618585-0224-46e3-94f7-b8796805894d from image 2b9c46c4-9208-4502-bc57-17459c8a9fd2 at location (None, None). {{(pid=83206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 13:37:13 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Image download 0.00 MB at 0.00 MB/s Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8673cd0-32aa-4116-898d-94c417e849ae]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:14 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD Sep 10 13:37:14 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:37:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Flow 'volume_create_manager' (3eccf98a-eaa8-4115-ace9-3709e4dfbf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23dccb76-79b4-46a1-a51d-12b8fb9b4d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23dccb76-79b4-46a1-a51d-12b8fb9b4d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1225942406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb77a7b-5687-463d-878b-c3e9a5f1e9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65642717dc074f5f8fb6ee5178eace3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:15Z,use_quota=True,user_id='23a13b60fb78447c8851a61c0914f222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033e303c-b8f9-4bd6-b7d7-71c1e349e521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033e303c-b8f9-4bd6-b7d7-71c1e349e521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996846d9-5b3e-4887-af74-b6fcb2f51701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996846d9-5b3e-4887-af74-b6fcb2f51701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb77a7b-5687-463d-878b-c3e9a5f1e9fc', 'volume_name': 'volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b10dbd0-1074-4141-8cc5-bb90b97c9f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b10dbd0-1074-4141-8cc5-bb90b97c9f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f58083e-c17c-49b7-8e46-837d57ff58ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:15 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Volume 9bb77a7b-5687-463d-878b-c3e9a5f1e9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc', 'volume_size': 1} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1225942406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb77a7b-5687-463d-878b-c3e9a5f1e9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65642717dc074f5f8fb6ee5178eace3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:15Z,use_quota=True,user_id='23a13b60fb78447c8851a61c0914f222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Creating volume 9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:37:15 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:37:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:15 devstack quobyte-client[83260]: System call of process 92056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:15 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=86, name=volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:37:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc 1073741824" returned: 0 in 0.535s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" returned: 0 in 0.210s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] <== create_volume: return (882ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:37:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f58083e-c17c-49b7-8e46-837d57ff58ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62314827-43f5-4702-9b70-757add78ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:17 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Volume volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc (9bb77a7b-5687-463d-878b-c3e9a5f1e9fc): created successfully Sep 10 13:37:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62314827-43f5-4702-9b70-757add78ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Flow 'volume_create_manager' (3eccf98a-eaa8-4115-ace9-3709e4dfbf27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:17 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-31d4e19a-cad1-4bd8-b55d-096f920ec2ef tempest-SnapshotMetadataTestJSON-1628146566 None] Created volume successfully. Sep 10 13:37:17 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Sep 10 13:37:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD" returned: 0 in 3.763s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:18 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD Sep 10 13:37:18 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:37:19 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Creating offline snapshot 0ed25e4f-d582-451e-a3fb-e5625943ce5d of volume 9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:37:19 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ee045a-eaf6-45af-9cd4-9e23160ccd81]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" returned: 0 in 0.692s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:20 devstack quobyte-client[83260]: System call of process 92072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:20 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=87, name=volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:37:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d 1G" returned: 0 in 0.525s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:21 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Sep 10 13:37:21 devstack quobyte-client[83260]: System call of process 92075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD" returned: 1 in 3.582s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Temporary image 2b9c46c4-9208-4502-bc57-17459c8a9fd2 is fetched for user 4b4fd10da6354fc28e07d873b27e43d1. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "qemu-img rebase -u -b volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d" returned: 0 in 0.391s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d" returned: 0 in 0.202s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d" returned: 0 in 0.348s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.info" returned: 0 in 0.288s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:37:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.info" returned: 0 in 0.143s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:22 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab4664-509f-4edc-8d50-f9280d9b7dbd]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4f812fbe-91b1-49a3-abc5-a2e6841b053a tempest-SnapshotMetadataTestJSON-1628146566 None] Create snapshot completed successfully Sep 10 13:37:23 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD Sep 10 13:37:23 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "cinder-0ed25e4f-d582-451e-a3fb-e5625943ce5d-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-0ed25e4f-d582-451e-a3fb-e5625943ce5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:25 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "cinder-quobyte-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-quobyte-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "cinder-quobyte-0ed25e4f-d582-451e-a3fb-e5625943ce5d" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-quobyte-0ed25e4f-d582-451e-a3fb-e5625943ce5d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Deleting offline snapshot 0ed25e4f-d582-451e-a3fb-e5625943ce5d of volume 9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] snapshot_file for this snap is: volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[564bace7-d31a-45df-bd45-2952285fab93]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:25 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD" returned: 0 in 3.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:26 devstack quobyte-client[83260]: System call of process 92086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d" returned: 0 in 0.558s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:37:26 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8833af-1eb7-46d8-a431-4e6ca51b91c2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:26 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD Sep 10 13:37:26 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:37:26 devstack quobyte-client[83260]: System call of process 92090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" returned: 0 in 0.618s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:27 devstack quobyte-client[83260]: System call of process 92094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d" returned: 0 in 0.368s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc.0ed25e4f-d582-451e-a3fb-e5625943ce5d" returned: 0 in 0.161s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-quobyte-0ed25e4f-d582-451e-a3fb-e5625943ce5d" released by "_delete_snapshot" :: held 2.265s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-quobyte-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" released by "delete_snapshot" :: held 2.304s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:28 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Created reservations ['0a52ca60-f9e5-4094-82f0-672d798de55e', 'f649bfbe-22bc-4c80-a80c-3cd7b35bd33f', 'b723fa71-0dcd-4611-b38f-b8f1b719964e', 'b38c6fe7-d967-4ffa-804e-f7654aed245f'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Delete snapshot completed successfully. Sep 10 13:37:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-88f2b8d9-9d99-4422-9f44-350184622a37 tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-0ed25e4f-d582-451e-a3fb-e5625943ce5d-delete_snapshot" released by "delete_snapshot" :: held 3.062s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:29 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD" returned: 1 in 3.339s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53618585-0224-46e3-94f7-b8796805894d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c525ff3a264b6a85028aa32ecaa040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:12Z,use_quota=True,user_id='4b4fd10da6354fc28e07d873b27e43d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Creating volume 53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:37:29 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:29 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=89, name=volume-53618585-0224-46e3-94f7-b8796805894d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "cinder-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d 1073741824" returned: 0 in 0.528s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d" returned: 0 in 0.263s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] <== create_volume: return (835ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:37:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "cinder-quobyte-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Attempting download of 2b9c46c4-9208-4502-bc57-17459c8a9fd2 ((None, None)) to volume 53618585-0224-46e3-94f7-b8796805894d. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-quobyte-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" acquired by "delete_volume" :: waited 0.109s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a49399-1233-4765-8b75-c366fca633a7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa34395-ad19-4e05-b76c-e7f5a3dea6b1]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b9c46c4-9208-4502-bc57-17459c8a9fd2_cts0nde4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" returned: 0 in 0.634s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" returned: 0 in 0.129s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b9c46c4-9208-4502-bc57-17459c8a9fd2_cts0nde4" returned: 0 in 0.676s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b9c46c4-9208-4502-bc57-17459c8a9fd2_cts0nde4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-quobyte-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc" released by "delete_volume" :: held 1.139s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=139,cinder:SELECT=95,cinder:DELETE=12,cinder:INSERT=35 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b9c46c4-9208-4502-bc57-17459c8a9fd2_cts0nde4" returned: 1 in 0.718s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b9c46c4-9208-4502-bc57-17459c8a9fd2_cts0nde4' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc4a0a2-2295-4e67-a2db-865f03acdbbf]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Created reservations ['9eedc209-2972-49c5-9801-e9d01fa6bd3e', '295e4ba7-328f-4711-a1d8-87e641126a52', '85b3367a-82b4-4d08-93ac-8c3a5ed61bbd', 'd33eb834-7153-4ba6-a4b6-26640fad7a45'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:DELETE=11,cinder:UPDATE=127,cinder:SELECT=82,cinder:INSERT=30 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.067s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.268s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:33 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Deleted volume successfully. Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] 2b9c46c4-9208-4502-bc57-17459c8a9fd2 was raw, converting to raw {{(pid=83206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:33 devstack quobyte-client[83260]: System call of process 92120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:33 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=89, name=volume-53618585-0224-46e3-94f7-b8796805894d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-90d16734-f430-4bdd-ac7b-21c6993e692d tempest-SnapshotMetadataTestJSON-1628146566 None] Lock "cinder-9bb77a7b-5687-463d-878b-c3e9a5f1e9fc-delete_volume" released by "delete_volume" :: held 4.281s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d" returned: 0 in 0.378s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b9c46c4-9208-4502-bc57-17459c8a9fd2_0m8l_9eedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:37:33 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 13:37:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:34 devstack quobyte-client[83260]: System call of process 92123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d 1G" returned: 0 in 0.194s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:34 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5687f10-4ad3-49b9-a357-969d39078fe7]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d" returned: 0 in 0.498s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d" returned: 1 in 0.588s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Downloaded image 2b9c46c4-9208-4502-bc57-17459c8a9fd2 ((None, None)) to volume 53618585-0224-46e3-94f7-b8796805894d successfully. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Temporary image 2b9c46c4-9208-4502-bc57-17459c8a9fd2 for user 4b4fd10da6354fc28e07d873b27e43d1 is deleted. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Marking volume 53618585-0224-46e3-94f7-b8796805894d as bootable. {{(pid=83206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Copying metadata from image 2b9c46c4-9208-4502-bc57-17459c8a9fd2 to 53618585-0224-46e3-94f7-b8796805894d. {{(pid=83206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Creating volume glance metadata for volume 53618585-0224-46e3-94f7-b8796805894d backed by image 2b9c46c4-9208-4502-bc57-17459c8a9fd2 with: {'image_id': '2b9c46c4-9208-4502-bc57-17459c8a9fd2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3fd8fab5193eb3bc7803358fb5609cc1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c40e42-2d98-4450-8fe5-5ae154730688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53618585-0224-46e3-94f7-b8796805894d', 'volume_size': 1, 'image_id': '2b9c46c4-9208-4502-bc57-17459c8a9fd2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fd8fab5193eb3bc7803358fb5609cc1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35c525ff3a264b6a85028aa32ecaa040', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '297841e283f639924723c86c1874bf71e4a70a60a4f1b4100ac2f7dfd95e8fac327dcdcc5828ce2e488477a1a3f18462a486352ef2f0fa4c0c8b8f736cdfd89c', 'id': '2b9c46c4-9208-4502-bc57-17459c8a9fd2', 'created_at': datetime.datetime(2025, 9, 10, 11, 37, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 37, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b9c46c4-9208-4502-bc57-17459c8a9fd2/file', 'properties': {}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52c32c7-e348-4c27-be35-1782e531fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:36 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Volume volume-53618585-0224-46e3-94f7-b8796805894d (53618585-0224-46e3-94f7-b8796805894d): created successfully Sep 10 13:37:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52c32c7-e348-4c27-be35-1782e531fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Flow 'volume_create_manager' (db3c2fdd-30bd-4ce5-acbd-ab4a09d12e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a99dc3e7-8888-4558-b90a-bcf771ccdd62 tempest-VolumeImageDependencyTests-1744423806 None] Created volume successfully. Sep 10 13:37:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Acquiring lock "cinder-53618585-0224-46e3-94f7-b8796805894d-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Lock "cinder-53618585-0224-46e3-94f7-b8796805894d-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Acquiring lock "cinder-quobyte-53618585-0224-46e3-94f7-b8796805894d" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Lock "cinder-quobyte-53618585-0224-46e3-94f7-b8796805894d" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:37 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cac12d-8ec2-457d-b6a6-f17eeafc2c62]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d" returned: 0 in 0.605s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d" returned: 1 in 0.729s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:37:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-53618585-0224-46e3-94f7-b8796805894d" returned: 0 in 0.168s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Lock "cinder-quobyte-53618585-0224-46e3-94f7-b8796805894d" released by "delete_volume" :: held 2.028s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:39 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Created reservations ['19c20102-4736-4b9c-82bf-c910f6ecb6ab', '08101b5b-85a9-46e1-9009-c7e5439e5d62', '0d643dc7-71fc-48c9-b6aa-e9476dd07445', '40a4af46-ff7f-4192-98e2-ffbe4ddd5f11'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.166s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:40 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:40 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Deleted volume successfully. Sep 10 13:37:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2efb1f18-2420-45b1-b56b-ef8635efcdd4 tempest-VolumeImageDependencyTests-1744423806 None] Lock "cinder-53618585-0224-46e3-94f7-b8796805894d-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:42 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:42 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:37:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Flow 'volume_create_manager' (28fb159c-c3bb-434c-9dab-79d56cbe24f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a1894c-a5ed-4e47-b06b-21a23f91507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a1894c-a5ed-4e47-b06b-21a23f91507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1485673415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82537854-a18f-4910-87be-340638eae704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21314f2277f64505aa049340c3c4c43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:42Z,use_quota=True,user_id='695aefb46f56491d979db6a7a4d03d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0b7b6e-cd07-45ea-b3ce-65fc034e99fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0b7b6e-cd07-45ea-b3ce-65fc034e99fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae26be2-85b8-45d4-ab15-93d6ae4d7d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae26be2-85b8-45d4-ab15-93d6ae4d7d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82537854-a18f-4910-87be-340638eae704', 'volume_name': 'volume-82537854-a18f-4910-87be-340638eae704', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7720418-a914-4a78-9e5f-af0de8c92eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7720418-a914-4a78-9e5f-af0de8c92eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa2f176-a3ff-4eb6-8f84-bb39fd915082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:43 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Volume 82537854-a18f-4910-87be-340638eae704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82537854-a18f-4910-87be-340638eae704', 'volume_size': 1} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1485673415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82537854-a18f-4910-87be-340638eae704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21314f2277f64505aa049340c3c4c43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:42Z,use_quota=True,user_id='695aefb46f56491d979db6a7a4d03d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Creating volume 82537854-a18f-4910-87be-340638eae704 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:37:43 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:43 devstack quobyte-client[83260]: System call of process 92172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:43 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=90, name=volume-82537854-a18f-4910-87be-340638eae704, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704 1073741824" returned: 0 in 0.499s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704" returned: 0 in 0.150s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] <== create_volume: return (728ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:37:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa2f176-a3ff-4eb6-8f84-bb39fd915082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82537854-a18f-4910-87be-340638eae704', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5d60e2-d025-4d54-b347-07ff72f870db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:44 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Volume volume-82537854-a18f-4910-87be-340638eae704 (82537854-a18f-4910-87be-340638eae704): created successfully Sep 10 13:37:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5d60e2-d025-4d54-b347-07ff72f870db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:44 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Flow 'volume_create_manager' (28fb159c-c3bb-434c-9dab-79d56cbe24f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:44 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9e2a760f-baee-4e57-aeb6-a6e9a8d8cdb7 tempest-VolumesTransfersTest-497680590 None] Created volume successfully. Sep 10 13:37:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4e70b63f-a514-4d1f-915d-94ad0f6cf343 tempest-VolumesTransfersTest-469631618 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4e70b63f-a514-4d1f-915d-94ad0f6cf343 tempest-VolumesTransfersTest-469631618 None] Transfer volume completed successfully. Sep 10 13:37:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Acquiring lock "cinder-82537854-a18f-4910-87be-340638eae704-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-82537854-a18f-4910-87be-340638eae704-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:48 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Acquiring lock "cinder-quobyte-82537854-a18f-4910-87be-340638eae704" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-quobyte-82537854-a18f-4910-87be-340638eae704" acquired by "delete_volume" :: waited 0.017s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:48 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea99f9b-d404-4ba1-9f38-ebbaefac95d9]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704" returned: 0 in 0.556s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82537854-a18f-4910-87be-340638eae704" returned: 0 in 0.109s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-quobyte-82537854-a18f-4910-87be-340638eae704" released by "delete_volume" :: held 0.844s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Created reservations ['1ecd06bd-948d-44de-bc01-fd3965633e1b', '4fad741d-7461-484d-8f16-efe05fa99380', '2471cc21-cb6c-4d37-9dcf-139eef463dee', 'd6fc3ceb-8db8-464c-a625-03392840d9ba'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.104s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:50 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Deleted volume successfully. Sep 10 13:37:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55f1ceab-62b0-471d-af5f-d5280b450cd5 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-82537854-a18f-4910-87be-340638eae704-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Flow 'volume_create_manager' (678eedb7-3b3c-49bc-a897-a55be3593423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3b3d72-a5d6-40d5-918a-d0cb146e5bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3b3d72-a5d6-40d5-918a-d0cb146e5bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-172096729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff8d731-d8cd-41a4-b263-501fe3db5367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21314f2277f64505aa049340c3c4c43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:51Z,use_quota=True,user_id='695aefb46f56491d979db6a7a4d03d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32e5607-bd28-4a80-9648-5d0a939fd846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32e5607-bd28-4a80-9648-5d0a939fd846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f13b066-1e8d-4b69-835a-beed9c6220c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f13b066-1e8d-4b69-835a-beed9c6220c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff8d731-d8cd-41a4-b263-501fe3db5367', 'volume_name': 'volume-dff8d731-d8cd-41a4-b263-501fe3db5367', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abba155-9b81-4415-a957-da62efdda233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abba155-9b81-4415-a957-da62efdda233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e321926e-3c9d-483a-ae42-38645949faf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:51 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Volume dff8d731-d8cd-41a4-b263-501fe3db5367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff8d731-d8cd-41a4-b263-501fe3db5367', 'volume_size': 1} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-172096729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff8d731-d8cd-41a4-b263-501fe3db5367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21314f2277f64505aa049340c3c4c43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:51Z,use_quota=True,user_id='695aefb46f56491d979db6a7a4d03d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Creating volume dff8d731-d8cd-41a4-b263-501fe3db5367 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:37:51 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:37:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:51 devstack quobyte-client[83260]: System call of process 92184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:37:51 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=91, name=volume-dff8d731-d8cd-41a4-b263-501fe3db5367, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367 1073741824" returned: 0 in 0.391s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367" returned: 0 in 0.131s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] <== create_volume: return (624ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.639s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e321926e-3c9d-483a-ae42-38645949faf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff8d731-d8cd-41a4-b263-501fe3db5367', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94858c43-299e-4f62-8281-e5a741b7eb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:37:52 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Volume volume-dff8d731-d8cd-41a4-b263-501fe3db5367 (dff8d731-d8cd-41a4-b263-501fe3db5367): created successfully Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94858c43-299e-4f62-8281-e5a741b7eb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:37:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Flow 'volume_create_manager' (678eedb7-3b3c-49bc-a897-a55be3593423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:37:52 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-96d45844-eaf5-4aef-937d-0539e9f39d81 tempest-VolumesTransfersTest-497680590 None] Created volume successfully. Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Acquiring lock "cinder-dff8d731-d8cd-41a4-b263-501fe3db5367-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-dff8d731-d8cd-41a4-b263-501fe3db5367-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:54 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Acquiring lock "cinder-quobyte-dff8d731-d8cd-41a4-b263-501fe3db5367" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-quobyte-dff8d731-d8cd-41a4-b263-501fe3db5367" acquired by "delete_volume" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ff39a-db42-42b4-9652-f7de41e4d36f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367" returned: 0 in 0.430s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff8d731-d8cd-41a4-b263-501fe3db5367" returned: 0 in 0.110s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-quobyte-dff8d731-d8cd-41a4-b263-501fe3db5367" released by "delete_volume" :: held 0.726s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Created reservations ['2fcb9428-6ea3-4e75-af00-6972d1300a63', '5b313781-e067-416f-b80b-367a497fbf14', '341d2fa5-d255-4331-9e12-750d1dfff5aa', '4348078d-8846-4113-8ce8-5ba15137a99e'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.110s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:37:55 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:37:55 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Deleted volume successfully. Sep 10 13:37:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0af63d88-8c21-4a18-b97a-d0aa49b00b94 tempest-VolumesTransfersTest-1686194145 None] Lock "cinder-dff8d731-d8cd-41a4-b263-501fe3db5367-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:38:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Flow 'volume_create_manager' (4c416906-dff1-4ff7-8b28-7e4d17e0a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83b4fd6-8c2c-49b3-ac67-b82714831d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83b4fd6-8c2c-49b3-ac67-b82714831d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-823989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e43519f-1133-4593-9778-d2d9ca2d6c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e076db44b23b48d98b319d635b656d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:05Z,use_quota=True,user_id='2e36e59796cd485b8d6cc66c2e9cc81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16cf0ba-6b1a-4f80-9cd5-e48ff1658130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16cf0ba-6b1a-4f80-9cd5-e48ff1658130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa985fb-6fa9-422c-b143-5ddf2836e9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa985fb-6fa9-422c-b143-5ddf2836e9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e43519f-1133-4593-9778-d2d9ca2d6c93', 'volume_name': 'volume-9e43519f-1133-4593-9778-d2d9ca2d6c93', 'volume_size': 2}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f679270-dc3a-4ca6-91c7-47b2b07f7b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f679270-dc3a-4ca6-91c7-47b2b07f7b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10baf59-d461-4bc6-b90b-c41010f57892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:04 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Volume 9e43519f-1133-4593-9778-d2d9ca2d6c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e43519f-1133-4593-9778-d2d9ca2d6c93', 'volume_size': 2} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-823989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e43519f-1133-4593-9778-d2d9ca2d6c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e076db44b23b48d98b319d635b656d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:05Z,use_quota=True,user_id='2e36e59796cd485b8d6cc66c2e9cc81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Creating volume 9e43519f-1133-4593-9778-d2d9ca2d6c93 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:38:04 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:38:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93 2147483648 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:05 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=92, name=volume-9e43519f-1133-4593-9778-d2d9ca2d6c93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:38:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93 2147483648" returned: 0 in 0.591s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93" returned: 0 in 0.150s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] <== create_volume: return (863ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:38:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:38:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10baf59-d461-4bc6-b90b-c41010f57892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e43519f-1133-4593-9778-d2d9ca2d6c93', 'volume_size': 2}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b55ea59-e52d-42ab-9c05-866c0a456055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Volume volume-9e43519f-1133-4593-9778-d2d9ca2d6c93 (9e43519f-1133-4593-9778-d2d9ca2d6c93): created successfully Sep 10 13:38:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b55ea59-e52d-42ab-9c05-866c0a456055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Flow 'volume_create_manager' (4c416906-dff1-4ff7-8b28-7e4d17e0a886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:38:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a1bad0b5-084e-47ec-9591-655a5e068e5a tempest-VolumesCloneNegativeTest-1109869900 None] Created volume successfully. Sep 10 13:38:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Acquiring lock "cinder-9e43519f-1133-4593-9778-d2d9ca2d6c93-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:38:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Lock "cinder-9e43519f-1133-4593-9778-d2d9ca2d6c93-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:38:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:38:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Acquiring lock "cinder-quobyte-9e43519f-1133-4593-9778-d2d9ca2d6c93" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:38:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Lock "cinder-quobyte-9e43519f-1133-4593-9778-d2d9ca2d6c93" acquired by "delete_volume" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:38:07 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af0b9d0-4e28-4da1-a014-8d9eadc103a2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:38:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:08 devstack quobyte-client[83260]: System call of process 92231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:38:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93" returned: 0 in 1.151s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9e43519f-1133-4593-9778-d2d9ca2d6c93" returned: 0 in 0.527s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Lock "cinder-quobyte-9e43519f-1133-4593-9778-d2d9ca2d6c93" released by "delete_volume" :: held 2.783s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:38:10 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Created reservations ['bbe75b45-dfbd-427c-a140-e3dd3e2f0164', '5702ead2-c097-468a-94c9-d3c78fc9f6da', '7836e1dd-ee7e-4640-a253-0c40b5f021ad', '401154cd-08ea-44cb-9614-c2df41bc20b4'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.312s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.723s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:38:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:38:12 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Deleted volume successfully. Sep 10 13:38:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0310db68-3ad9-4da5-bd69-729be69a0f71 tempest-VolumesCloneNegativeTest-1109869900 None] Lock "cinder-9e43519f-1133-4593-9778-d2d9ca2d6c93-delete_volume" released by "delete_volume" :: held 5.412s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:38:21 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:DELETE=4,cinder:UPDATE=50,cinder:SELECT=28,cinder:INSERT=9 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=45,cinder:SELECT=32,cinder:INSERT=15,cinder:DELETE=5 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:38:22 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Flow 'volume_create_manager' (c6d3e93c-6d85-42cc-8040-f1a473545606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db33ff9-6838-40d8-9c31-559f933caa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db33ff9-6838-40d8-9c31-559f933caa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-486520634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05a5998-b0a4-43ca-9638-ff271f03e39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718ca18b8e674c4f85b9a39c141d03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:22Z,use_quota=True,user_id='82ccb19e086743668b3c242b495c4d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28931ef8-aa4e-4489-ac7c-d4f81f2cac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28931ef8-aa4e-4489-ac7c-d4f81f2cac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830d1adf-cf83-4c4e-b1fe-ef2791fc68fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830d1adf-cf83-4c4e-b1fe-ef2791fc68fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05a5998-b0a4-43ca-9638-ff271f03e39c', 'volume_name': 'volume-b05a5998-b0a4-43ca-9638-ff271f03e39c', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cb712c-d7f3-4a25-a1ee-742bc05e7a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cb712c-d7f3-4a25-a1ee-742bc05e7a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9de5a4c-4848-46d9-832e-6581c2c02963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:22 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Volume b05a5998-b0a4-43ca-9638-ff271f03e39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05a5998-b0a4-43ca-9638-ff271f03e39c', 'volume_size': 1} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-486520634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05a5998-b0a4-43ca-9638-ff271f03e39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718ca18b8e674c4f85b9a39c141d03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:22Z,use_quota=True,user_id='82ccb19e086743668b3c242b495c4d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Creating volume b05a5998-b0a4-43ca-9638-ff271f03e39c {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:38:22 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:38:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:23 devstack quobyte-client[83260]: System call of process 92318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:38:23 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=93, name=volume-b05a5998-b0a4-43ca-9638-ff271f03e39c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c 1073741824" returned: 0 in 0.523s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c" returned: 0 in 0.173s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9de5a4c-4848-46d9-832e-6581c2c02963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05a5998-b0a4-43ca-9638-ff271f03e39c', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f78386-602c-44ee-bc02-7791cc59ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:38:23 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Volume volume-b05a5998-b0a4-43ca-9638-ff271f03e39c (b05a5998-b0a4-43ca-9638-ff271f03e39c): created successfully Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f78386-602c-44ee-bc02-7791cc59ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:38:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Flow 'volume_create_manager' (c6d3e93c-6d85-42cc-8040-f1a473545606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:38:24 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1307e390-7805-49ca-9d97-cf04abe60c59 tempest-VolumesNegativeTest-1258890244 None] Created volume successfully. Sep 10 13:38:33 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:38:34 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.258s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:39:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Acquiring lock "cinder-b05a5998-b0a4-43ca-9638-ff271f03e39c-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Lock "cinder-b05a5998-b0a4-43ca-9638-ff271f03e39c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:13 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Acquiring lock "cinder-quobyte-b05a5998-b0a4-43ca-9638-ff271f03e39c" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Lock "cinder-quobyte-b05a5998-b0a4-43ca-9638-ff271f03e39c" acquired by "delete_volume" :: waited 0.012s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f9e4f-6a57-44dd-8780-76f503f3d703]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:13 devstack quobyte-client[83260]: System call of process 92540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c" returned: 0 in 0.491s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b05a5998-b0a4-43ca-9638-ff271f03e39c" returned: 0 in 0.106s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Lock "cinder-quobyte-b05a5998-b0a4-43ca-9638-ff271f03e39c" released by "delete_volume" :: held 0.778s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Created reservations ['f45622c7-0af5-42b0-8b97-c0e65e2ae718', 'fd395fb0-1623-4e43-80ab-c6582998eb27', '3e1817cd-2cac-4b23-b494-0b2ddf2bf85d', '1925b810-7007-4808-ace0-c8973ff2d171'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.097s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:39:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Deleted volume successfully. Sep 10 13:39:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f184d780-872a-4811-8199-8196d695cd75 tempest-VolumesNegativeTest-1258890244 None] Lock "cinder-b05a5998-b0a4-43ca-9638-ff271f03e39c-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Flow 'volume_create_manager' (bd4c2138-97f3-4895-bdd8-5cf547867686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c44631-e046-4536-a00c-dd2e10a52aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c44631-e046-4536-a00c-dd2e10a52aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1111518324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3939c1-91b8-4479-8289-abcc888df4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4c0b45f70a40d6869bbc191ab01913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:18Z,use_quota=True,user_id='b7432a5ff691493b8b8cd1e79be825f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71647910-633e-4ed4-96e3-918a2b0bf642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71647910-633e-4ed4-96e3-918a2b0bf642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa55ed8-c642-495d-995f-be7f635629dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa55ed8-c642-495d-995f-be7f635629dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3939c1-91b8-4479-8289-abcc888df4e1', 'volume_name': 'volume-0f3939c1-91b8-4479-8289-abcc888df4e1', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a592a1-678c-46f9-b998-8f0eb38b36a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a592a1-678c-46f9-b998-8f0eb38b36a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4a4f1e-7f7d-45ad-955b-6eb90c9dd0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:18 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume 0f3939c1-91b8-4479-8289-abcc888df4e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3939c1-91b8-4479-8289-abcc888df4e1', 'volume_size': 1} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1111518324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3939c1-91b8-4479-8289-abcc888df4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4c0b45f70a40d6869bbc191ab01913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:18Z,use_quota=True,user_id='b7432a5ff691493b8b8cd1e79be825f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Creating volume 0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:39:18 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:39:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:18 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=94, name=volume-0f3939c1-91b8-4479-8289-abcc888df4e1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 1073741824" returned: 0 in 0.541s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1" returned: 0 in 0.140s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] <== create_volume: return (793ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4a4f1e-7f7d-45ad-955b-6eb90c9dd0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3939c1-91b8-4479-8289-abcc888df4e1', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc26d0-724f-4d69-9bd5-49ba3b05a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:19 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume volume-0f3939c1-91b8-4479-8289-abcc888df4e1 (0f3939c1-91b8-4479-8289-abcc888df4e1): created successfully Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc26d0-724f-4d69-9bd5-49ba3b05a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Flow 'volume_create_manager' (bd4c2138-97f3-4895-bdd8-5cf547867686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:39:19 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ee29c210-c172-407d-a0ce-e8b7df1cb439 tempest-VolumesSnapshotListTestJSON-466508309 None] Created volume successfully. Sep 10 13:39:20 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Creating offline snapshot b83a24e6-c305-4119-bb6b-23cf6d905989 of volume 0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:39:20 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b906f3-f5c8-405b-bd7d-7d84acf70def]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1" returned: 0 in 0.486s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:21 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=95, name=volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:39:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 1G" returned: 0 in 0.413s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f3939c1-91b8-4479-8289-abcc888df4e1 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:22 devstack quobyte-client[83260]: System call of process 92566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img rebase -u -b volume-0f3939c1-91b8-4479-8289-abcc888df4e1 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.209s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.117s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.164s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.info" returned: 0 in 0.153s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.info" returned: 0 in 0.103s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c84a0b22-3c50-48a0-a716-88750830c004 tempest-VolumesSnapshotListTestJSON-466508309 None] Create snapshot completed successfully Sep 10 13:39:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Flow 'volume_create_manager' (d1c34dff-501b-437c-94d4-3ccb83811f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe8614d-f501-4f05-8bbf-c32f477f9b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe8614d-f501-4f05-8bbf-c32f477f9b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-134099270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7822b2-1ef8-45e2-8d4e-e652cafa5794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3a999bc48645ae914f220a3cffba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:24Z,use_quota=True,user_id='8f6068345d7942deb9c1a4525927ada6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac832ae-3481-4711-ad25-97643847c383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac832ae-3481-4711-ad25-97643847c383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe7b4d3-ab41-4b7b-a6cb-b5b0fd9d87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe7b4d3-ab41-4b7b-a6cb-b5b0fd9d87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7822b2-1ef8-45e2-8d4e-e652cafa5794', 'volume_name': 'volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3ae6ab-6e0d-4908-a504-0ace76f371f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3ae6ab-6e0d-4908-a504-0ace76f371f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5044ee-5f4a-4522-99f7-a0c187357ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:24 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Volume 2a7822b2-1ef8-45e2-8d4e-e652cafa5794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794', 'volume_size': 1} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-134099270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7822b2-1ef8-45e2-8d4e-e652cafa5794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3a999bc48645ae914f220a3cffba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:24Z,use_quota=True,user_id='8f6068345d7942deb9c1a4525927ada6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Creating volume 2a7822b2-1ef8-45e2-8d4e-e652cafa5794 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:39:24 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:24 devstack quobyte-client[83260]: System call of process 92579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:24 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=97, name=volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:39:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794 1073741824" returned: 0 in 0.398s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794" returned: 0 in 0.101s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] <== create_volume: return (536ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.547s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.407s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Creating offline snapshot 7c26612c-6921-471a-bad9-189135f148ba of volume 0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5044ee-5f4a-4522-99f7-a0c187357ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d83ccf-86eb-4c4a-8641-76403fc42e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c434f10c-d9d3-49cb-84ba-85169512f15e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:25 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Volume volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794 (2a7822b2-1ef8-45e2-8d4e-e652cafa5794): created successfully Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d83ccf-86eb-4c4a-8641-76403fc42e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:39:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Flow 'volume_create_manager' (d1c34dff-501b-437c-94d4-3ccb83811f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:39:25 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-eef2613d-e400-4776-863f-e373cda5d187 tempest-AttachVolumeTestJSON-643609489 None] Created volume successfully. Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.570s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3939c1-91b8-4479-8289-abcc888df4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:26 devstack quobyte-client[83260]: System call of process 92586 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:26 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=98, name=volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba 1G" returned: 0 in 0.280s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img rebase -u -b volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.164s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.121s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.087s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.660s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-faa65e4e-56f1-4243-8200-398527cb77ff tempest-VolumesSnapshotListTestJSON-466508309 None] Create snapshot completed successfully Sep 10 13:39:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Creating offline snapshot 4ef85ad4-710a-4cd4-a5c1-300119202424 of volume 0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:39:28 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d9e39-2f55-496f-bb4e-8acf8a6f9812]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:28 devstack quobyte-client[83260]: System call of process 92594 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.398s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:28 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3939c1-91b8-4479-8289-abcc888df4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:39:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:28 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=99, name=volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:39:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 1G" returned: 0 in 0.383s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img rebase -u -b volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424" returned: 0 in 0.164s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424" returned: 0 in 0.095s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424" returned: 0 in 0.104s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.467s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0491a465-7b4b-46ed-9726-0f9720271cf0 tempest-VolumesSnapshotListTestJSON-466508309 None] Create snapshot completed successfully Sep 10 13:39:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:30 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd7f4b-d636-4877-9817-c8d060f5a6ef]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:31 devstack quobyte-client[83260]: System call of process 92614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794" returned: 0 in 0.701s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.782s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-4ef85ad4-710a-4cd4-a5c1-300119202424-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-4ef85ad4-710a-4cd4-a5c1-300119202424-delete_snapshot" acquired by "delete_snapshot" :: waited 0.112s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" acquired by "delete_snapshot" :: waited 0.067s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-quobyte-4ef85ad4-710a-4cd4-a5c1-300119202424" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-4ef85ad4-710a-4cd4-a5c1-300119202424" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Deleting offline snapshot 4ef85ad4-710a-4cd4-a5c1-300119202424 of volume 0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] snapshot_file for this snap is: volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5080d2ee-2738-48c8-8118-9e5a9d5d02c8', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:39:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[790fa5e4-2e32-4fb9-aed2-e2be11b2dfde]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-cd7b7a67-e6b8-4ee8-9b7a-832e8fa1f037 req-6d283884-5071-46b7-a285-6e5b733b57e0 tempest-AttachVolumeTestJSON-643609489 None] attachment_update completed successfully. Sep 10 13:39:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424" returned: 0 in 0.517s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3939c1-91b8-4479-8289-abcc888df4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:39:32 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b88505-ab60-4aea-8f42-5069fc9b8f7f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.467s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3939c1-91b8-4479-8289-abcc888df4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424" returned: 0 in 0.544s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.4ef85ad4-710a-4cd4-a5c1-300119202424" returned: 0 in 0.150s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-4ef85ad4-710a-4cd4-a5c1-300119202424" released by "_delete_snapshot" :: held 1.978s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" released by "delete_snapshot" :: held 2.002s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Created reservations ['beceadc9-dda5-4f8c-a3a4-02a14fd29052', '1e7b03f0-8008-42c5-b407-31fe0106e40e', 'afdd2e37-4212-4ecb-ae5f-e345f40e5ab4', '49f34d4e-9a41-458a-9666-267919216599'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:39:34 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Delete snapshot completed successfully. Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-029a3240-5b43-42b5-84fe-c37db3300ea6 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-4ef85ad4-710a-4cd4-a5c1-300119202424-delete_snapshot" released by "delete_snapshot" :: held 2.568s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-7c26612c-6921-471a-bad9-189135f148ba-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-7c26612c-6921-471a-bad9-189135f148ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:34 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-quobyte-7c26612c-6921-471a-bad9-189135f148ba" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-7c26612c-6921-471a-bad9-189135f148ba" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Deleting offline snapshot 7c26612c-6921-471a-bad9-189135f148ba of volume 0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] snapshot_file for this snap is: volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f112d85-c7ec-490d-be20-7b46ffe61ba7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:35 devstack quobyte-client[83260]: System call of process 93012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.525s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3939c1-91b8-4479-8289-abcc888df4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc5eba-4efc-431f-ac31-b2e2cb7554ba]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.403s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3939c1-91b8-4479-8289-abcc888df4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:36 devstack quobyte-client[83260]: System call of process 93019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.221s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.7c26612c-6921-471a-bad9-189135f148ba" returned: 0 in 0.085s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-7c26612c-6921-471a-bad9-189135f148ba" released by "_delete_snapshot" :: held 1.542s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" released by "delete_snapshot" :: held 1.568s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:36 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Created reservations ['7f640cb8-fca7-41c6-bd71-d9de5bef59a4', 'dbe2a066-b016-4843-84c9-8ae592c2ca5a', '23637992-06d6-4b9e-9da3-abbcbae29416', 'e85397eb-a946-4cce-aa39-4964819519d9'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:39:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Delete snapshot completed successfully. Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-832faa9e-a908-44c5-94fa-f5295d92bf55 tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-7c26612c-6921-471a-bad9-189135f148ba-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-b83a24e6-c305-4119-bb6b-23cf6d905989-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-b83a24e6-c305-4119-bb6b-23cf6d905989-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-quobyte-b83a24e6-c305-4119-bb6b-23cf6d905989" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-b83a24e6-c305-4119-bb6b-23cf6d905989" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Deleting offline snapshot b83a24e6-c305-4119-bb6b-23cf6d905989 of volume 0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] snapshot_file for this snap is: volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8268143-c628-4626-ae50-b5274f398848]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.378s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3939c1-91b8-4479-8289-abcc888df4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[758abd5f-2cf1-486d-b21c-9274759663f7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1" returned: 0 in 0.433s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.224s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1.b83a24e6-c305-4119-bb6b-23cf6d905989" returned: 0 in 0.087s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-b83a24e6-c305-4119-bb6b-23cf6d905989" released by "_delete_snapshot" :: held 1.413s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" released by "delete_snapshot" :: held 1.452s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Created reservations ['6c80c2a9-a282-4ad3-9f8a-726ae9493467', '01e3262f-669c-49ee-9157-18acebc5c4b2', '5b37cc2d-6eb3-41c3-85a4-a0fb8b98a06b', 'e87de227-c15b-4018-accb-9f2751c9def3'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:39:39 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Delete snapshot completed successfully. Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-17dece51-b3b4-49b9-9648-3acd59da458a tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-b83a24e6-c305-4119-bb6b-23cf6d905989-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-0f3939c1-91b8-4479-8289-abcc888df4e1-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-0f3939c1-91b8-4479-8289-abcc888df4e1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:39 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" acquired by "delete_volume" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01c87ea-c33b-4725-9a29-1d7201184dfa]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:39:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:40 devstack quobyte-client[83260]: System call of process 93035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1" returned: 0 in 0.518s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0f3939c1-91b8-4479-8289-abcc888df4e1" returned: 0 in 0.086s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-quobyte-0f3939c1-91b8-4479-8289-abcc888df4e1" released by "delete_volume" :: held 0.785s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Created reservations ['4ef14dc5-3265-4054-beb9-deed2e92dcad', 'a9535e9c-9d6d-414a-a840-8acc651a1fe8', '8b203888-686b-4b81-a140-fd267d1421a1', 'b506ef4c-af3b-48d8-8dd8-a6eeb083fd21'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:39:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:39:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.086s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:39:41 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:39:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Deleted volume successfully. Sep 10 13:39:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-821b17bf-fd59-44e5-8144-5d990bb21a1d tempest-VolumesSnapshotListTestJSON-466508309 None] Lock "cinder-0f3939c1-91b8-4479-8289-abcc888df4e1-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:39:50 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=42,cinder:UPDATE=43,cinder:INSERT=7,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:39:51 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=29,cinder:INSERT=13,cinder:UPDATE=39,cinder:DELETE=5 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.163s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:40:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:40:25 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Flow 'volume_create_manager' (e3bde53d-bbeb-4928-8d4e-ca3a0700c4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725e9b3e-60f5-4ac4-8425-15796f79d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725e9b3e-60f5-4ac4-8425-15796f79d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-805382861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76258042-6380-45ee-8d09-b4a7bc0b62be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdfd6a1980ac4307bade2a5134dbba04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:25Z,use_quota=True,user_id='941c33d87c4c43eba169ffc0cda0bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c742c0c-2b71-4748-b91e-6ec4242d3e2a),volume_type_id=2c742c0c-2b71-4748-b91e-6ec4242d3e2a)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b025005-2f8e-4264-82c9-16aec66dec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b025005-2f8e-4264-82c9-16aec66dec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9430db25-e14b-4e84-80d5-c8839d5efac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9430db25-e14b-4e84-80d5-c8839d5efac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76258042-6380-45ee-8d09-b4a7bc0b62be', 'volume_name': 'volume-76258042-6380-45ee-8d09-b4a7bc0b62be', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0521ad68-88ee-49ee-96b7-6221614df21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0521ad68-88ee-49ee-96b7-6221614df21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a884c3-a2bb-48e5-b09b-154ba11f8936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:25 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Volume 76258042-6380-45ee-8d09-b4a7bc0b62be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76258042-6380-45ee-8d09-b4a7bc0b62be', 'volume_size': 1} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-805382861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76258042-6380-45ee-8d09-b4a7bc0b62be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdfd6a1980ac4307bade2a5134dbba04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:25Z,use_quota=True,user_id='941c33d87c4c43eba169ffc0cda0bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c742c0c-2b71-4748-b91e-6ec4242d3e2a),volume_type_id=2c742c0c-2b71-4748-b91e-6ec4242d3e2a)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Creating volume 76258042-6380-45ee-8d09-b4a7bc0b62be {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:40:25 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:40:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:26 devstack quobyte-client[83260]: System call of process 93658 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:40:26 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=100, name=volume-76258042-6380-45ee-8d09-b4a7bc0b62be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:40:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Flow 'volume_create_manager' (c60515da-4c84-4208-92b3-bd623a2d0149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03218a64-57fc-40ea-82e5-9ed173ce3d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03218a64-57fc-40ea-82e5-9ed173ce3d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-391946289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a7acc9-97ef-4153-bc3b-86b0c5ef4158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdfd6a1980ac4307bade2a5134dbba04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:26Z,use_quota=True,user_id='941c33d87c4c43eba169ffc0cda0bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c20293-c208-44e1-a4b2-2c318b1969ff),volume_type_id=b1c20293-c208-44e1-a4b2-2c318b1969ff)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af67617e-313c-4bfd-a76a-92d5852b7c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af67617e-313c-4bfd-a76a-92d5852b7c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eb1b47-c1bc-4f31-b90d-d1d5da135799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eb1b47-c1bc-4f31-b90d-d1d5da135799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a7acc9-97ef-4153-bc3b-86b0c5ef4158', 'volume_name': 'volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418e6243-fc3a-454e-a21f-e6c7742b0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418e6243-fc3a-454e-a21f-e6c7742b0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f510569c-edd7-49d5-ba2f-f2706fbf63ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:26 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume 83a7acc9-97ef-4153-bc3b-86b0c5ef4158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158', 'volume_size': 1} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be 1073741824" returned: 0 in 0.899s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be" returned: 0 in 0.259s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] <== create_volume: return (1222ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-391946289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a7acc9-97ef-4153-bc3b-86b0c5ef4158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdfd6a1980ac4307bade2a5134dbba04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:26Z,use_quota=True,user_id='941c33d87c4c43eba169ffc0cda0bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c20293-c208-44e1-a4b2-2c318b1969ff),volume_type_id=b1c20293-c208-44e1-a4b2-2c318b1969ff)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Creating volume 83a7acc9-97ef-4153-bc3b-86b0c5ef4158 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:40:27 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:27 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=101, name=volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a884c3-a2bb-48e5-b09b-154ba11f8936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76258042-6380-45ee-8d09-b4a7bc0b62be', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e94d3c9-d084-456c-bfe9-9d2d7797ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158 1073741824" returned: 0 in 0.506s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:28 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Volume volume-76258042-6380-45ee-8d09-b4a7bc0b62be (76258042-6380-45ee-8d09-b4a7bc0b62be): created successfully Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e94d3c9-d084-456c-bfe9-9d2d7797ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Flow 'volume_create_manager' (e3bde53d-bbeb-4928-8d4e-ca3a0700c4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:40:28 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Flow 'volume_create_manager' (51464d57-d45d-4e0a-b33b-8d0cfcda3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e364ce60-b48e-469c-be37-0a93d40c640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-62ad30e3-1900-4838-a2a3-a7bfdee83eaa tempest-TestInstancesWithCinderVolumes-503090524 None] Created volume successfully. Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158" returned: 0 in 0.560s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] <== create_volume: return (1108ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e364ce60-b48e-469c-be37-0a93d40c640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-877813012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fcd9cc-980a-4fa0-847b-960091e7213d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdfd6a1980ac4307bade2a5134dbba04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:27Z,use_quota=True,user_id='941c33d87c4c43eba169ffc0cda0bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d8c8449-5a82-4446-a88c-6c2dc21e4fdc),volume_type_id=7d8c8449-5a82-4446-a88c-6c2dc21e4fdc)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832003af-fbad-45fe-90d5-72efd7ccc6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832003af-fbad-45fe-90d5-72efd7ccc6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfb2b21-3521-4e4e-8fad-410691591faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f510569c-edd7-49d5-ba2f-f2706fbf63ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec80b4f9-973e-4555-896c-0927a6cd5539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:28 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158 (83a7acc9-97ef-4153-bc3b-86b0c5ef4158): created successfully Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec80b4f9-973e-4555-896c-0927a6cd5539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Flow 'volume_create_manager' (c60515da-4c84-4208-92b3-bd623a2d0149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:40:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-73bf0a32-a0d7-47a1-8e8d-345fa80d969f tempest-TestInstancesWithCinderVolumes-503090524 None] Created volume successfully. Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfb2b21-3521-4e4e-8fad-410691591faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5fcd9cc-980a-4fa0-847b-960091e7213d', 'volume_name': 'volume-b5fcd9cc-980a-4fa0-847b-960091e7213d', 'volume_size': 1, 'image_id': '81d12887-87b7-499f-b57c-8f81916334e6', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--420845780', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fdfd6a1980ac4307bade2a5134dbba04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81d12887-87b7-499f-b57c-8f81916334e6', 'created_at': datetime.datetime(2025, 9, 10, 11, 40, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 40, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81d12887-87b7-499f-b57c-8f81916334e6/file', 'properties': {}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08712a2-f879-4742-a924-6f87b541eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08712a2-f879-4742-a924-6f87b541eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8850c41a-d544-4905-8da7-5dbafe0183b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:28 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume b5fcd9cc-980a-4fa0-847b-960091e7213d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5fcd9cc-980a-4fa0-847b-960091e7213d', 'volume_size': 1, 'image_id': '81d12887-87b7-499f-b57c-8f81916334e6', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--420845780', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fdfd6a1980ac4307bade2a5134dbba04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81d12887-87b7-499f-b57c-8f81916334e6', 'created_at': datetime.datetime(2025, 9, 10, 11, 40, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 40, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81d12887-87b7-499f-b57c-8f81916334e6/file', 'properties': {}}, 'image_service': } Sep 10 13:40:28 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Cloning b5fcd9cc-980a-4fa0-847b-960091e7213d from image 81d12887-87b7-499f-b57c-8f81916334e6 at location (None, None). {{(pid=83206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 13:40:30 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD, size 20.69 MB, duration 1.95 sec {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 13:40:30 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Image download 20.69 MB at 10.63 MB/s Sep 10 13:40:30 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc0d299-38e7-42ca-ab3e-85f88512eda9]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:40:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:31 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD Sep 10 13:40:31 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:40:33 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Sep 10 13:40:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD" returned: 0 in 2.211s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:33 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Temporary image 81d12887-87b7-499f-b57c-8f81916334e6 is fetched for user 941c33d87c4c43eba169ffc0cda0bb35. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 13:40:33 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e47ea-ac84-4421-8f27-70fbeeda1abd]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:40:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:33 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD Sep 10 13:40:33 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:40:35 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD" returned: 0 in 2.342s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-877813012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fcd9cc-980a-4fa0-847b-960091e7213d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdfd6a1980ac4307bade2a5134dbba04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:27Z,use_quota=True,user_id='941c33d87c4c43eba169ffc0cda0bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d8c8449-5a82-4446-a88c-6c2dc21e4fdc),volume_type_id=7d8c8449-5a82-4446-a88c-6c2dc21e4fdc)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Creating volume b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:40:35 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:40:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:36 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=102, name=volume-b5fcd9cc-980a-4fa0-847b-960091e7213d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d 1073741824" returned: 0 in 0.379s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 0 in 0.114s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] <== create_volume: return (590ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.631s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Attempting download of 81d12887-87b7-499f-b57c-8f81916334e6 ((None, None)) to volume b5fcd9cc-980a-4fa0-847b-960091e7213d. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f8c739-48c9-42b5-982f-d1f68c5f2e29]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:40:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81d12887-87b7-499f-b57c-8f81916334e6_li9fcmom {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81d12887-87b7-499f-b57c-8f81916334e6_li9fcmom" returned: 0 in 0.456s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81d12887-87b7-499f-b57c-8f81916334e6_li9fcmom {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81d12887-87b7-499f-b57c-8f81916334e6_li9fcmom" returned: 1 in 0.429s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81d12887-87b7-499f-b57c-8f81916334e6_li9fcmom' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:40:37 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c000b88-86f1-448b-8a75-8a202a94dcdf]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:40:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:38 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] 81d12887-87b7-499f-b57c-8f81916334e6 was qcow2, converting to raw {{(pid=83206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 13:40:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:38 devstack quobyte-client[83260]: System call of process 93704 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:40:38 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=102, name=volume-b5fcd9cc-980a-4fa0-847b-960091e7213d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:40:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 0 in 1.385s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:39 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81d12887-87b7-499f-b57c-8f81916334e6_apoj7gsndevstack@QuobyteHD, size 112.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:40:39 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Converted 112.00 MB image at 78.64 MB/s Sep 10 13:40:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d 1G" returned: 0 in 0.160s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a123b-3148-48ff-8c0f-133f211ad847]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:40:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 0 in 0.450s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 1 in 0.424s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Downloaded image 81d12887-87b7-499f-b57c-8f81916334e6 ((None, None)) to volume b5fcd9cc-980a-4fa0-847b-960091e7213d successfully. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Temporary image 81d12887-87b7-499f-b57c-8f81916334e6 for user 941c33d87c4c43eba169ffc0cda0bb35 is deleted. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Marking volume b5fcd9cc-980a-4fa0-847b-960091e7213d as bootable. {{(pid=83206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Copying metadata from image 81d12887-87b7-499f-b57c-8f81916334e6 to b5fcd9cc-980a-4fa0-847b-960091e7213d. {{(pid=83206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Creating volume glance metadata for volume b5fcd9cc-980a-4fa0-847b-960091e7213d backed by image 81d12887-87b7-499f-b57c-8f81916334e6 with: {'image_id': '81d12887-87b7-499f-b57c-8f81916334e6', 'image_name': 'tempest-scenario-img--420845780', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8850c41a-d544-4905-8da7-5dbafe0183b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fcd9cc-980a-4fa0-847b-960091e7213d', 'volume_size': 1, 'image_id': '81d12887-87b7-499f-b57c-8f81916334e6', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--420845780', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fdfd6a1980ac4307bade2a5134dbba04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81d12887-87b7-499f-b57c-8f81916334e6', 'created_at': datetime.datetime(2025, 9, 10, 11, 40, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 40, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81d12887-87b7-499f-b57c-8f81916334e6/file', 'properties': {}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab2aa93-9fc4-4631-8926-47948265ba31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:40:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Volume volume-b5fcd9cc-980a-4fa0-847b-960091e7213d (b5fcd9cc-980a-4fa0-847b-960091e7213d): created successfully Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab2aa93-9fc4-4631-8926-47948265ba31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:40:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Flow 'volume_create_manager' (51464d57-d45d-4e0a-b33b-8d0cfcda3058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:40:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c5cb77cf-42b2-48b9-8c23-65236d680a6f tempest-TestInstancesWithCinderVolumes-503090524 None] Created volume successfully. Sep 10 13:40:51 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:40:51 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=7,cinder:SELECT=10,cinder:DELETE=3,cinder:INSERT=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:40:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:40:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:40:52 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c1c7a6-fa4b-417d-9e3d-62e63e683547]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:40:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 0 in 0.709s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:40:53 devstack quobyte-client[83260]: System call of process 93778 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:40:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 1 in 0.595s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:40:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:40:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.459s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:40:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-b5fcd9cc-980a-4fa0-847b-960091e7213d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a194edef-6415-4974-b49c-0cb1de01045d', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:40:53 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:40:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-ec9db6ba-455a-4b48-8857-cb765cba7fc9 req-9756ed22-2ea4-4c8f-9bc0-aa0c43dee39b tempest-TestInstancesWithCinderVolumes-503090524 None] attachment_update completed successfully. Sep 10 13:41:04 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:41:04 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.313s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:41:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:41:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-08bae7e9-5373-4d45-8c0b-c908ec61cf1d req-46444f5b-6a95-4334-bfeb-ae03b51f8417 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:41:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-08bae7e9-5373-4d45-8c0b-c908ec61cf1d req-46444f5b-6a95-4334-bfeb-ae03b51f8417 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:41:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-08bae7e9-5373-4d45-8c0b-c908ec61cf1d req-46444f5b-6a95-4334-bfeb-ae03b51f8417 tempest-AttachVolumeTestJSON-643609489 None] Terminate volume connection completed successfully. Sep 10 13:41:36 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-08bae7e9-5373-4d45-8c0b-c908ec61cf1d req-46444f5b-6a95-4334-bfeb-ae03b51f8417 tempest-AttachVolumeTestJSON-643609489 None] Deleting attachment 5080d2ee-2738-48c8-8118-9e5a9d5d02c8. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:41:46 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:41:46 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.440s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:42:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:42:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:42:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:42:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:42:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:42:17 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb093ee0-1db7-45ff-9b6f-8f4956b7a364]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:42:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:42:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be" returned: 0 in 0.550s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:42:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.643s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:42:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-76258042-6380-45ee-8d09-b4a7bc0b62be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3804ae23-7ded-4f9d-97d1-1ad8b260ba41', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:42:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:42:18 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-d8d21ac2-a869-4a1d-b51d-5f055bbe58ea req-fc3488aa-c1f3-4f77-b441-60cfc59d6b35 tempest-TestInstancesWithCinderVolumes-503090524 None] attachment_update completed successfully. Sep 10 13:42:28 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:42:28 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:42:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:42:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:42:29 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11adf9aa-14a4-4fcc-bcce-4c78ca07e8cf]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:42:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:42:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158" returned: 0 in 0.469s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:42:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.547s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:42:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3063705d-3952-4887-8611-388b7fa6c0a8', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:42:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:42:30 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-cd3ffb6e-53cc-477c-8498-322d15c0978d req-42472512-82ff-4230-9e49-8caaa7de0d24 tempest-TestInstancesWithCinderVolumes-503090524 None] attachment_update completed successfully. Sep 10 13:42:40 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:42:40 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:43:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-ce8121a5-24cc-458f-8895-3d66740d90c3 req-a86794f8-e085-4291-9646-441c3fdf70dc tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-ce8121a5-24cc-458f-8895-3d66740d90c3 req-a86794f8-e085-4291-9646-441c3fdf70dc tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-ce8121a5-24cc-458f-8895-3d66740d90c3 req-a86794f8-e085-4291-9646-441c3fdf70dc tempest-TestInstancesWithCinderVolumes-503090524 None] Terminate volume connection completed successfully. Sep 10 13:43:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-ce8121a5-24cc-458f-8895-3d66740d90c3 req-a86794f8-e085-4291-9646-441c3fdf70dc tempest-TestInstancesWithCinderVolumes-503090524 None] Deleting attachment 3804ae23-7ded-4f9d-97d1-1ad8b260ba41. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:43:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "cinder-76258042-6380-45ee-8d09-b4a7bc0b62be-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:43:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-76258042-6380-45ee-8d09-b4a7bc0b62be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:43:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "cinder-quobyte-76258042-6380-45ee-8d09-b4a7bc0b62be" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:43:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-quobyte-76258042-6380-45ee-8d09-b4a7bc0b62be" acquired by "delete_volume" :: waited 0.012s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:43:07 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f7fa2-cbbd-44aa-8598-bc724587a512]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:43:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:43:07 devstack quobyte-client[83260]: System call of process 94271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be" returned: 0 in 0.724s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-76258042-6380-45ee-8d09-b4a7bc0b62be" returned: 0 in 0.144s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-quobyte-76258042-6380-45ee-8d09-b4a7bc0b62be" released by "delete_volume" :: held 1.146s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:43:08 devstack cinder-volume[83206]: WARNING cinder.quota [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-937388930-935739405 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-937388930-935739405, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:43:08 devstack cinder-volume[83206]: WARNING cinder.quota [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-937388930-935739405 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-937388930-935739405, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Created reservations ['bc7b20b7-077b-4e5a-b14b-908befc98eda', '22ed4c04-69cd-4266-9ec4-bc0d92dd995b', 'd36e332b-b465-4924-9c4e-eb773fba67a0', '539296d8-449b-47e8-aea2-42c9dcf911f6'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:43:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.097s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:43:09 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:43:09 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Deleted volume successfully. Sep 10 13:43:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a85422b1-62ff-4bc1-ab72-7614bcee2313 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-76258042-6380-45ee-8d09-b4a7bc0b62be-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.161s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:43:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:43:18 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:43:19 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:43:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-7f7f46da-9a10-43c5-a474-879ac60feec3 req-c8f35bd5-bcae-42c6-9121-137d4b5ecb30 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-7f7f46da-9a10-43c5-a474-879ac60feec3 req-c8f35bd5-bcae-42c6-9121-137d4b5ecb30 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-7f7f46da-9a10-43c5-a474-879ac60feec3 req-c8f35bd5-bcae-42c6-9121-137d4b5ecb30 tempest-TestInstancesWithCinderVolumes-503090524 None] Terminate volume connection completed successfully. Sep 10 13:43:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7f7f46da-9a10-43c5-a474-879ac60feec3 req-c8f35bd5-bcae-42c6-9121-137d4b5ecb30 tempest-TestInstancesWithCinderVolumes-503090524 None] Deleting attachment 3063705d-3952-4887-8611-388b7fa6c0a8. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:43:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "cinder-83a7acc9-97ef-4153-bc3b-86b0c5ef4158-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:43:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-83a7acc9-97ef-4153-bc3b-86b0c5ef4158-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:43:39 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "cinder-quobyte-83a7acc9-97ef-4153-bc3b-86b0c5ef4158" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:43:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-quobyte-83a7acc9-97ef-4153-bc3b-86b0c5ef4158" acquired by "delete_volume" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:43:39 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3692c-9f34-4789-998d-eac6c6d16dbc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:43:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:43:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158" returned: 0 in 0.888s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:43:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:43:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83a7acc9-97ef-4153-bc3b-86b0c5ef4158" returned: 0 in 0.177s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:43:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-quobyte-83a7acc9-97ef-4153-bc3b-86b0c5ef4158" released by "delete_volume" :: held 1.268s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:43:40 devstack cinder-volume[83206]: WARNING cinder.quota [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942439766-1843752996 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942439766-1843752996, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:43:40 devstack cinder-volume[83206]: WARNING cinder.quota [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942439766-1843752996 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942439766-1843752996, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Created reservations ['abc341b4-964e-4b83-a0e0-1ac0897469cf', 'b5628711-4065-4708-ac5f-173724ce8997', '6cf15040-8ba8-44a1-bcc9-0b2d510fe00e', '604968bc-bf55-4226-adbb-0a37af8a3fe2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.214s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:43:41 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:43:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Deleted volume successfully. Sep 10 13:43:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-036498c7-3280-471d-b007-fca98bde75e9 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-83a7acc9-97ef-4153-bc3b-86b0c5ef4158-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:43:51 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:43:52 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:43:54 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-0c02c546-bfcc-46f4-bf8b-61087d546584 req-8978aaa4-5472-4756-9b75-7ac009385ff2 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-0c02c546-bfcc-46f4-bf8b-61087d546584 req-8978aaa4-5472-4756-9b75-7ac009385ff2 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:55 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-0c02c546-bfcc-46f4-bf8b-61087d546584 req-8978aaa4-5472-4756-9b75-7ac009385ff2 tempest-TestInstancesWithCinderVolumes-503090524 None] Terminate volume connection completed successfully. Sep 10 13:43:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-0c02c546-bfcc-46f4-bf8b-61087d546584 req-8978aaa4-5472-4756-9b75-7ac009385ff2 tempest-TestInstancesWithCinderVolumes-503090524 None] Deleting attachment a194edef-6415-4974-b49c-0cb1de01045d. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:43:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "cinder-b5fcd9cc-980a-4fa0-847b-960091e7213d-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:43:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-b5fcd9cc-980a-4fa0-847b-960091e7213d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:43:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:43:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "cinder-quobyte-b5fcd9cc-980a-4fa0-847b-960091e7213d" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:43:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-quobyte-b5fcd9cc-980a-4fa0-847b-960091e7213d" acquired by "delete_volume" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:44:00 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[af765292-a801-4ae3-b518-808c40dd33d4]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:44:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:44:00 devstack quobyte-client[83260]: System call of process 94539 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:44:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 0 in 0.381s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:44:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:44:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 1 in 0.408s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b5fcd9cc-980a-4fa0-847b-960091e7213d" returned: 0 in 0.117s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-quobyte-b5fcd9cc-980a-4fa0-847b-960091e7213d" released by "delete_volume" :: held 1.286s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:44:01 devstack cinder-volume[83206]: WARNING cinder.quota [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-903242791-1894352784 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-903242791-1894352784, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:44:01 devstack cinder-volume[83206]: WARNING cinder.quota [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-903242791-1894352784 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-903242791-1894352784, it is now deprecated. Please use the default quota class for default quota. Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Created reservations ['c88fc433-9836-4ef7-a6ff-837ac194fb62', '1826d9ce-0861-4aa6-a7e1-6bc5ca5a6a32', '602c8a4e-e3c2-4115-a686-565513cfe9db', '51522bec-37dc-4f61-9269-0b51a97d0ead'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.115s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:44:01 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:44:01 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Deleted volume successfully. Sep 10 13:44:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-36ecc0a6-8c75-42fb-afde-1a8ee1efced4 tempest-TestInstancesWithCinderVolumes-503090524 None] Lock "cinder-b5fcd9cc-980a-4fa0-847b-960091e7213d-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.243s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:44:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:44:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:44:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:45:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:45:00 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:45:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Flow 'volume_create_manager' (9a6e137d-f080-457a-940c-2387a84c9633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:45:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eb9b17-9496-4e2c-b20e-4e2b0b8824c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eb9b17-9496-4e2c-b20e-4e2b0b8824c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-997264421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3a999bc48645ae914f220a3cffba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:01Z,use_quota=True,user_id='8f6068345d7942deb9c1a4525927ada6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e3e3cc-8194-4671-9709-1c2773c3a83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e3e3cc-8194-4671-9709-1c2773c3a83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdb652f-a07b-4474-a712-544e43b3433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdb652f-a07b-4474-a712-544e43b3433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07', 'volume_name': 'volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69661cc2-618f-4668-a4a2-979180cdd38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69661cc2-618f-4668-a4a2-979180cdd38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f545972-65a5-4604-b630-239163dcf7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:01 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Volume dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07', 'volume_size': 1} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-997264421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3a999bc48645ae914f220a3cffba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:01Z,use_quota=True,user_id='8f6068345d7942deb9c1a4525927ada6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Creating volume dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:45:01 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:45:01 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=103, name=volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 1073741824" returned: 0 in 0.351s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07" returned: 0 in 0.157s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] <== create_volume: return (578ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.590s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f545972-65a5-4604-b630-239163dcf7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a32e36-f246-46e4-b0be-c3f07224b88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:01 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Volume volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 (dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07): created successfully Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a32e36-f246-46e4-b0be-c3f07224b88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Flow 'volume_create_manager' (9a6e137d-f080-457a-940c-2387a84c9633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:45:01 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b44b8ff4-ee94-4558-98bf-705646255b87 tempest-AttachVolumeTestJSON-643609489 None] Created volume successfully. Sep 10 13:45:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:45:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:45:07 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eec4be-54f2-4966-9e20-2ff2f964aa6a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:45:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:45:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07" returned: 0 in 0.448s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:45:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.519s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:45:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b070fb31-92be-450d-b5f4-950655fc1398', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:45:08 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:45:09 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-43cc8701-b61f-4279-9602-22c5f44fad7d req-f5fa6eb0-d6a5-4aa7-997a-147b5da42e58 tempest-AttachVolumeTestJSON-643609489 None] attachment_update completed successfully. Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.234s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:45:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:45:17 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:45:17 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:45:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Flow 'volume_create_manager' (bec38a3d-93dd-45d0-ab05-1d36cfdd2a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:45:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61084512-cf3d-4f90-95c0-5f2c8531b2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61084512-cf3d-4f90-95c0-5f2c8531b2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1228956072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb4388f-bce2-4f2e-8af1-7e264a5bbbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3a999bc48645ae914f220a3cffba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:17Z,use_quota=True,user_id='8f6068345d7942deb9c1a4525927ada6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9717010-c09f-42c5-b5ec-4c1935d9893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9717010-c09f-42c5-b5ec-4c1935d9893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024536c2-b619-4367-9d9d-e2935af473dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024536c2-b619-4367-9d9d-e2935af473dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb4388f-bce2-4f2e-8af1-7e264a5bbbad', 'volume_name': 'volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4c6e33-17be-40d6-b366-90317a3b774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4c6e33-17be-40d6-b366-90317a3b774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13407a97-8b81-4b89-9d14-b2a272c5af23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:18 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Volume 7eb4388f-bce2-4f2e-8af1-7e264a5bbbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad', 'volume_size': 1} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1228956072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb4388f-bce2-4f2e-8af1-7e264a5bbbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3a999bc48645ae914f220a3cffba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:17Z,use_quota=True,user_id='8f6068345d7942deb9c1a4525927ada6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Creating volume 7eb4388f-bce2-4f2e-8af1-7e264a5bbbad {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:45:18 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:45:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:45:18 devstack quobyte-client[83260]: System call of process 95145 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:45:18 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=104, name=volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:45:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad 1073741824" returned: 0 in 0.868s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:45:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:45:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad" returned: 0 in 0.275s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:45:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] <== create_volume: return (1391ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:45:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:45:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13407a97-8b81-4b89-9d14-b2a272c5af23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7f2ce0-c7f5-4634-a7b4-5ac3c85974cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:45:20 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Volume volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad (7eb4388f-bce2-4f2e-8af1-7e264a5bbbad): created successfully Sep 10 13:45:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7f2ce0-c7f5-4634-a7b4-5ac3c85974cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:45:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Flow 'volume_create_manager' (bec38a3d-93dd-45d0-ab05-1d36cfdd2a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:45:20 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f05cb21a-7ce2-4e47-a6d6-c7c7fff14b64 tempest-AttachVolumeTestJSON-643609489 None] Created volume successfully. Sep 10 13:45:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:45:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:45:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e70cf48-9fb5-445a-b7a5-792d5e18a298]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:45:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:45:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad" returned: 0 in 0.772s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:45:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:45:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a078e798-427f-4bf5-b794-219fe3a101e5', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:45:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:45:26 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-e2d6ca29-8477-44f0-ac07-ab997cbe39e5 req-3263ec28-c20e-4124-8301-eb1fd53c2839 tempest-AttachVolumeTestJSON-643609489 None] attachment_update completed successfully. Sep 10 13:45:36 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=14,cinder:DELETE=2,cinder:UPDATE=8 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:45:36 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=6,cinder:SELECT=12 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:45:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-4029a7b6-1e41-4f3c-b994-343c42f07133 req-fb67c475-1921-44a9-8a96-5087dcad2427 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:45:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-4029a7b6-1e41-4f3c-b994-343c42f07133 req-fb67c475-1921-44a9-8a96-5087dcad2427 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:45:55 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-4029a7b6-1e41-4f3c-b994-343c42f07133 req-fb67c475-1921-44a9-8a96-5087dcad2427 tempest-AttachVolumeTestJSON-643609489 None] Terminate volume connection completed successfully. Sep 10 13:45:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-4029a7b6-1e41-4f3c-b994-343c42f07133 req-fb67c475-1921-44a9-8a96-5087dcad2427 tempest-AttachVolumeTestJSON-643609489 None] Deleting attachment b070fb31-92be-450d-b5f4-950655fc1398. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:46:05 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.109s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:46:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:46:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:46:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-7ec6dc1e-d0d9-41f1-a8e1-4fbc841c1bbc req-07b5754b-7843-4f79-9d40-c01fc3075ec6 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:46:19 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-7ec6dc1e-d0d9-41f1-a8e1-4fbc841c1bbc req-07b5754b-7843-4f79-9d40-c01fc3075ec6 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:46:19 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-7ec6dc1e-d0d9-41f1-a8e1-4fbc841c1bbc req-07b5754b-7843-4f79-9d40-c01fc3075ec6 tempest-AttachVolumeTestJSON-643609489 None] Terminate volume connection completed successfully. Sep 10 13:46:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-7ec6dc1e-d0d9-41f1-a8e1-4fbc841c1bbc req-07b5754b-7843-4f79-9d40-c01fc3075ec6 tempest-AttachVolumeTestJSON-643609489 None] Deleting attachment a078e798-427f-4bf5-b794-219fe3a101e5. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:46:29 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:46:29 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "cinder-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:46:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Flow 'volume_create_manager' (f09c4c0e-da95-46b4-96e5-017c4a7c561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec00c706-5321-4479-bafd-3c8cebff0b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec00c706-5321-4479-bafd-3c8cebff0b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2119977913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c031c8-1cee-44c0-adba-c1c2680f2f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b94e350c994651adcc7bb2dd4a3150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:46:33Z,use_quota=True,user_id='941b7cb5738e4d80b37426c02f84b7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ac328-34d4-43f5-b998-7b5a0207ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ac328-34d4-43f5-b998-7b5a0207ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01a6e61-9f9a-4ecd-8ca7-1a58cbd36a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01a6e61-9f9a-4ecd-8ca7-1a58cbd36a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c031c8-1cee-44c0-adba-c1c2680f2f5f', 'volume_name': 'volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af77d479-00a5-48c9-9c8b-442c72efa4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af77d479-00a5-48c9-9c8b-442c72efa4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b32528-70ac-40c7-9cd5-b90a39788219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:46:33 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume a8c031c8-1cee-44c0-adba-c1c2680f2f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f', 'volume_size': 1} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2119977913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c031c8-1cee-44c0-adba-c1c2680f2f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b94e350c994651adcc7bb2dd4a3150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:46:33Z,use_quota=True,user_id='941b7cb5738e4d80b37426c02f84b7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Creating volume a8c031c8-1cee-44c0-adba-c1c2680f2f5f {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:46:33 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:46:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:33 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=105, name=volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:46:34 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "cinder-quobyte-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-quobyte-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad" acquired by "delete_volume" :: waited 0.073s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58da2ec-a1a0-4fc3-89fd-9ebdd4f8c1f7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f 1073741824" returned: 0 in 0.471s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f" returned: 0 in 0.160s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] <== create_volume: return (706ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b32528-70ac-40c7-9cd5-b90a39788219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1628df3c-3f38-4630-b5c6-492f09b448d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:46:34 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f (a8c031c8-1cee-44c0-adba-c1c2680f2f5f): created successfully Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1628df3c-3f38-4630-b5c6-492f09b448d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Flow 'volume_create_manager' (f09c4c0e-da95-46b4-96e5-017c4a7c561a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:46:34 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0a1672bd-0dcb-4f7d-b3ed-db00da223b6f tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Created volume successfully. Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad" returned: 0 in 0.634s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad" returned: 0 in 0.155s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-quobyte-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad" released by "delete_volume" :: held 0.933s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Created reservations ['48ccb1f8-4975-457b-9ffa-474bcf3daaea', '0e444ebe-02f4-447e-a0d7-79cc05084cf0', '0a8388a0-122d-4899-bb0f-ae55fd84e653', '259d4653-3b50-454e-bd46-983ba49aaf3b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.121s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:46:35 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Deleted volume successfully. Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9af92213-7d5f-4d48-8118-73e07bfc6b43 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-7eb4388f-bce2-4f2e-8af1-7e264a5bbbad-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:46:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "cinder-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:46:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "cinder-quobyte-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-quobyte-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07" acquired by "delete_volume" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e241e1-2549-44e1-b346-3c1f969207d7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07" returned: 0 in 0.437s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07" returned: 0 in 0.095s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-quobyte-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07" released by "delete_volume" :: held 0.702s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Created reservations ['909862a6-c552-4144-99f3-ead5937a5bb1', '4335d1df-26ff-4f0a-bd92-a600d597e682', '4ab0715a-56b7-4b63-823f-79b6ddc8c751', '61564a69-9523-4e7f-8b89-0c8fdd28d57c'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.084s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:46:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Deleted volume successfully. Sep 10 13:46:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76b7cf5d-bdf1-40a5-8823-af302291afb1 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-dff5481f-f3a9-4e8d-9f7b-3fd7adeb6b07-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:46:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "cinder-2a7822b2-1ef8-45e2-8d4e-e652cafa5794-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:46:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-2a7822b2-1ef8-45e2-8d4e-e652cafa5794-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:46:38 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:46:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "cinder-quobyte-2a7822b2-1ef8-45e2-8d4e-e652cafa5794" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:46:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-quobyte-2a7822b2-1ef8-45e2-8d4e-e652cafa5794" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:46:38 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc27d3d-472d-4364-9adb-552dece527ac]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:46:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794" returned: 0 in 0.593s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2a7822b2-1ef8-45e2-8d4e-e652cafa5794" returned: 0 in 0.137s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-quobyte-2a7822b2-1ef8-45e2-8d4e-e652cafa5794" released by "delete_volume" :: held 0.957s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9cae16-172d-4150-9cbd-cc0ffd4af3d8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Created reservations ['3859a1cd-9510-496f-b0ce-76b26ddbcdcf', '2af81516-075f-4306-8d69-4765139b090a', 'ad9f36a5-5448-463d-b394-3ff81376330a', 'f03af94d-186a-494c-a078-42004eee50bf'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f" returned: 0 in 0.655s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:46:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.368s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:46:41 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:46:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Deleted volume successfully. Sep 10 13:46:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36b9bee1-deda-4df4-84dc-4a04aa6ede56', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:46:41 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:46:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f1bd15f3-bfaa-48b2-893e-f40f429b93c9 tempest-AttachVolumeTestJSON-643609489 None] Lock "cinder-2a7822b2-1ef8-45e2-8d4e-e652cafa5794-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:46:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-8ba9f373-a25f-4e57-8c33-06893a6b91d8 req-69584739-6e26-43df-96b1-d5ad9b18910d tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] attachment_update completed successfully. Sep 10 13:46:51 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=18,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:46:51 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.109s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:47:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:47:13 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-1e9e71f1-0351-4296-90b1-aa8d49ad35a0 req-1be8afdd-f3a2-460b-87d4-d9d035a76747 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:47:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-1e9e71f1-0351-4296-90b1-aa8d49ad35a0 req-1be8afdd-f3a2-460b-87d4-d9d035a76747 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:47:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-1e9e71f1-0351-4296-90b1-aa8d49ad35a0 req-1be8afdd-f3a2-460b-87d4-d9d035a76747 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Terminate volume connection completed successfully. Sep 10 13:47:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-1e9e71f1-0351-4296-90b1-aa8d49ad35a0 req-1be8afdd-f3a2-460b-87d4-d9d035a76747 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Deleting attachment 36b9bee1-deda-4df4-84dc-4a04aa6ede56. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:47:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Acquiring lock "cinder-a8c031c8-1cee-44c0-adba-c1c2680f2f5f-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:47:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "cinder-a8c031c8-1cee-44c0-adba-c1c2680f2f5f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:47:16 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:47:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Acquiring lock "cinder-quobyte-a8c031c8-1cee-44c0-adba-c1c2680f2f5f" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:47:16 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "cinder-quobyte-a8c031c8-1cee-44c0-adba-c1c2680f2f5f" acquired by "delete_volume" :: waited 0.021s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:47:16 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[988719b9-1afb-4cd6-b33c-d4caeafbeab1]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:47:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:47:17 devstack quobyte-client[83260]: System call of process 95936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:47:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f" returned: 0 in 0.810s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:47:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:47:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8c031c8-1cee-44c0-adba-c1c2680f2f5f" returned: 0 in 0.141s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:47:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "cinder-quobyte-a8c031c8-1cee-44c0-adba-c1c2680f2f5f" released by "delete_volume" :: held 1.282s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Created reservations ['54885d9f-0fcc-4171-bdff-79bd97332e3c', '161dfc74-b48f-487e-900e-72fdbb16389d', 'b7f9a79a-ae82-4d30-a009-f440959a1610', '5962dbc3-c182-4013-a80c-310b847934dc'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.246s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:47:18 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:47:18 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Deleted volume successfully. Sep 10 13:47:19 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-db938609-6090-42fe-b316-1cc89d9ed0b0 tempest-TestServerVolumeAttachScenarioOldVersion-1214978918 None] Lock "cinder-a8c031c8-1cee-44c0-adba-c1c2680f2f5f-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:47:28 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:47:29 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.134s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:48:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:48:23 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Flow 'volume_create_manager' (142fc883-b62e-4840-a652-f6dce63bb142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4a41ed-28fc-4f99-9866-b544be23726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4a41ed-28fc-4f99-9866-b544be23726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1828139073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8584fa5-5f82-49ab-88fa-406ddf4477ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe47da029654f0bb490c7f0dc41635b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:48:23Z,use_quota=True,user_id='f68783a365b849c49ce0b9a6291f31bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d47f8af-5645-4406-863f-7b03deb46dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d47f8af-5645-4406-863f-7b03deb46dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3701726d-de65-4eb5-bb1c-43fea5e44aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3701726d-de65-4eb5-bb1c-43fea5e44aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8584fa5-5f82-49ab-88fa-406ddf4477ca', 'volume_name': 'volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59d6ada-5c28-4bd7-8163-75be5c6df3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59d6ada-5c28-4bd7-8163-75be5c6df3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52658c89-efc4-49a5-a3f4-d89befbfafe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:23 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume a8584fa5-5f82-49ab-88fa-406ddf4477ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca', 'volume_size': 1} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1828139073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8584fa5-5f82-49ab-88fa-406ddf4477ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe47da029654f0bb490c7f0dc41635b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:48:23Z,use_quota=True,user_id='f68783a365b849c49ce0b9a6291f31bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Creating volume a8584fa5-5f82-49ab-88fa-406ddf4477ca {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:48:23 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:48:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:23 devstack quobyte-client[83260]: System call of process 96214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:48:24 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=106, name=volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:48:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Flow 'volume_create_manager' (1947e83e-d134-48ac-ac2c-66484f7f7e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36030812-7250-44a2-bef0-805a35ba0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36030812-7250-44a2-bef0-805a35ba0546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1661819763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe47da029654f0bb490c7f0dc41635b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:48:24Z,use_quota=True,user_id='f68783a365b849c49ce0b9a6291f31bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879edd65-bced-4301-9a66-b567e0c1eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879edd65-bced-4301-9a66-b567e0c1eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16b5237-67a2-4b5d-a6c6-c63cfebd9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16b5237-67a2-4b5d-a6c6-c63cfebd9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb', 'volume_name': 'volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda33b88-8314-4827-93c8-a31901331421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda33b88-8314-4827-93c8-a31901331421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c39d67-a2c6-4683-b3d8-207f6ff8a2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:24 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume 87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb', 'volume_size': 1} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca 1073741824" returned: 0 in 0.795s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca" returned: 0 in 0.242s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] <== create_volume: return (1101ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1661819763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe47da029654f0bb490c7f0dc41635b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:48:24Z,use_quota=True,user_id='f68783a365b849c49ce0b9a6291f31bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Creating volume 87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:48:25 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:25 devstack quobyte-client[83260]: System call of process 96222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:48:25 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=107, name=volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52658c89-efc4-49a5-a3f4-d89befbfafe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f2c15-d548-4445-9471-076f601e6b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb 1073741824" returned: 0 in 0.578s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:25 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca (a8584fa5-5f82-49ab-88fa-406ddf4477ca): created successfully Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f2c15-d548-4445-9471-076f601e6b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Flow 'volume_create_manager' (142fc883-b62e-4840-a652-f6dce63bb142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:48:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb" returned: 0 in 0.427s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] <== create_volume: return (1039ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:48:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:26 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ccf39ee2-b430-41dd-ac7d-a959144e7ddd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Created volume successfully. Sep 10 13:48:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c39d67-a2c6-4683-b3d8-207f6ff8a2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e38346a-8d72-43fe-af87-1a5b13c4a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:26 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb (87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb): created successfully Sep 10 13:48:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e38346a-8d72-43fe-af87-1a5b13c4a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:26 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Flow 'volume_create_manager' (1947e83e-d134-48ac-ac2c-66484f7f7e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:48:26 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d2d7e90e-5102-4028-bd34-3e2528d0c008 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Created volume successfully. Sep 10 13:48:36 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:48:36 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:48:42 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:48:42 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:48:42 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Flow 'volume_create_manager' (c4ce9d04-adf8-4d94-83f1-1d246feb393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14c31ef-24a9-4faf-8c56-9c6bba2ded12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14c31ef-24a9-4faf-8c56-9c6bba2ded12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1878393902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaa988a-4387-4b0e-99f0-be39e6810f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af3ee7d0f04eeead60ced4aea992e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:48:43Z,use_quota=True,user_id='5e822f7052244097952fbbfa1ec7ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ea72ae-4272-4b1f-bd0b-7dce97f5e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ea72ae-4272-4b1f-bd0b-7dce97f5e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2470fe0b-50d7-4a6e-9559-6cd2290e6fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2470fe0b-50d7-4a6e-9559-6cd2290e6fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffaa988a-4387-4b0e-99f0-be39e6810f2b', 'volume_name': 'volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b853a19e-34bf-45a7-a2c2-7a0c995968e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b853a19e-34bf-45a7-a2c2-7a0c995968e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6eb0c-0e56-4e41-96b7-ee6f2b11882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:43 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Volume ffaa988a-4387-4b0e-99f0-be39e6810f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b', 'volume_size': 1} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1878393902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaa988a-4387-4b0e-99f0-be39e6810f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af3ee7d0f04eeead60ced4aea992e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:48:43Z,use_quota=True,user_id='5e822f7052244097952fbbfa1ec7ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Creating volume ffaa988a-4387-4b0e-99f0-be39e6810f2b {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:48:43 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:43 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=108, name=volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b 1073741824" returned: 0 in 0.416s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b" returned: 0 in 0.107s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] <== create_volume: return (587ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.598s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6eb0c-0e56-4e41-96b7-ee6f2b11882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249ca8cf-868c-4ae9-8952-622110d3e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:48:43 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Volume volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b (ffaa988a-4387-4b0e-99f0-be39e6810f2b): created successfully Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249ca8cf-868c-4ae9-8952-622110d3e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:48:43 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Flow 'volume_create_manager' (c4ce9d04-adf8-4d94-83f1-1d246feb393d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:48:44 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7a9fc720-9f08-4b2f-a10b-6c40104869a3 tempest-AttachVolumeNegativeTest-1038137060 None] Created volume successfully. Sep 10 13:48:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:48:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:48:50 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c67040-e891-4d57-9b3b-3bb08505d670]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:48:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:48:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b" returned: 0 in 0.758s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:48:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:48:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bac86e71-862a-4107-90f8-88d212ccf4d9', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:48:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:48:51 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-56af8a5b-77dd-4b64-94f2-fc8b298ead88 req-91c476ad-45fb-40a6-b8f8-ab50a7209313 tempest-AttachVolumeNegativeTest-1038137060 None] attachment_update completed successfully. Sep 10 13:49:01 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:49:01 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.401s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:49:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:50:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:50:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:50:06 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7804a62e-512f-4ea1-966e-b11570a89cca]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:50:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:50:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca" returned: 0 in 0.463s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:50:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.533s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:50:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9789bd2-7b83-4756-baac-212e5dd0fd58', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:50:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:50:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-cb4d071c-d40b-466a-adce-267823f02553 req-7808000a-32b5-453c-90b9-0dd3e278bcea tempest-TestServerVolumeAttachmentScenario-1136814025 None] attachment_update completed successfully. Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.125s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:50:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:50:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=5 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:50:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:50:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:50:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:50:19 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd1623e-5fb7-4755-aff9-5f9578fba0f7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:50:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:50:20 devstack quobyte-client[83260]: System call of process 97089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:50:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb" returned: 0 in 0.824s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:50:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.924s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:50:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a7de1a4-dfb8-4e5d-b745-39aa612d61b1', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:50:20 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:50:21 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-f1301418-3b0e-49e3-8520-2f1fb6777573 req-c38671b4-f84d-4ecd-8dad-78565813c8bd tempest-TestServerVolumeAttachmentScenario-1136814025 None] attachment_update completed successfully. Sep 10 13:50:31 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:50:31 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:50:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-321c8893-6705-45c7-9e89-5e809f55b3bf req-2da72687-acef-4928-8408-4426372a2a97 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:50:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-321c8893-6705-45c7-9e89-5e809f55b3bf req-2da72687-acef-4928-8408-4426372a2a97 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:50:49 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-321c8893-6705-45c7-9e89-5e809f55b3bf req-2da72687-acef-4928-8408-4426372a2a97 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Terminate volume connection completed successfully. Sep 10 13:50:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-321c8893-6705-45c7-9e89-5e809f55b3bf req-2da72687-acef-4928-8408-4426372a2a97 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Deleting attachment 6a7de1a4-dfb8-4e5d-b745-39aa612d61b1. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:50:59 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:51:10 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-e60a572f-3946-40b4-a51f-acdaf905ce51 req-a1ab5c93-d026-4535-9fff-a29723659a1b tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:51:10 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-e60a572f-3946-40b4-a51f-acdaf905ce51 req-a1ab5c93-d026-4535-9fff-a29723659a1b tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:51:10 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-e60a572f-3946-40b4-a51f-acdaf905ce51 req-a1ab5c93-d026-4535-9fff-a29723659a1b tempest-AttachVolumeNegativeTest-1038137060 None] Terminate volume connection completed successfully. Sep 10 13:51:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-e60a572f-3946-40b4-a51f-acdaf905ce51 req-a1ab5c93-d026-4535-9fff-a29723659a1b tempest-AttachVolumeNegativeTest-1038137060 None] Deleting attachment bac86e71-862a-4107-90f8-88d212ccf4d9. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.122s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:51:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:51:13 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-f874f47d-eec2-429e-9988-8538f46fdf1f req-700c04f2-25d6-4c44-a324-2ac816874059 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:51:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-f874f47d-eec2-429e-9988-8538f46fdf1f req-700c04f2-25d6-4c44-a324-2ac816874059 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:51:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-f874f47d-eec2-429e-9988-8538f46fdf1f req-700c04f2-25d6-4c44-a324-2ac816874059 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Terminate volume connection completed successfully. Sep 10 13:51:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-f874f47d-eec2-429e-9988-8538f46fdf1f req-700c04f2-25d6-4c44-a324-2ac816874059 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Deleting attachment f9789bd2-7b83-4756-baac-212e5dd0fd58. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:51:24 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:51:24 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:51:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "cinder-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:51:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:51:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:51:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "cinder-quobyte-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:51:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-quobyte-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:51:30 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea01a388-6c7e-4f7f-a262-13b883da5c0b]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:51:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:51:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb" returned: 0 in 0.503s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:51:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:51:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb" returned: 0 in 0.111s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:51:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-quobyte-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb" released by "delete_volume" :: held 0.802s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:51:31 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Created reservations ['ce8b8c6b-c1a4-43d8-9da4-d02dfdf1d7a7', '93339a2e-62b4-48b4-b29f-6f81afb5355e', 'f7d8d18a-86bb-4baa-abfb-793ead22398f', 'b2ae52be-4170-4c04-a1a8-973380cc1850'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:51:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Deleted volume successfully. Sep 10 13:51:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-56a57361-0f2c-43b9-85fc-ed0cbc1d7774 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-87a1e3e8-2cd6-4a07-a4e3-0944fa9597cb-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "cinder-a8584fa5-5f82-49ab-88fa-406ddf4477ca-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-a8584fa5-5f82-49ab-88fa-406ddf4477ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:51:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "cinder-quobyte-a8584fa5-5f82-49ab-88fa-406ddf4477ca" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-quobyte-a8584fa5-5f82-49ab-88fa-406ddf4477ca" acquired by "delete_volume" :: waited 0.017s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f831348-41bf-4a82-9b78-4052ca30df45]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca" returned: 0 in 0.479s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a8584fa5-5f82-49ab-88fa-406ddf4477ca" returned: 0 in 0.101s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:51:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-quobyte-a8584fa5-5f82-49ab-88fa-406ddf4477ca" released by "delete_volume" :: held 0.756s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Created reservations ['e4f20b20-d44c-4bbf-ae6c-0a693f78d504', 'fb350ae3-392c-4ae8-ae87-e469cf858850', 'da6ea7de-efa5-4710-9625-62b6c6b26089', '5716d8d9-16a6-40d4-9f70-e24a643c232b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.099s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:51:34 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Deleted volume successfully. Sep 10 13:51:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-49949c44-be47-40fe-ad16-7b820001aea8 tempest-TestServerVolumeAttachmentScenario-1136814025 None] Lock "cinder-a8584fa5-5f82-49ab-88fa-406ddf4477ca-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:51:44 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:51:44 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.268s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:52:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:52:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:52:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Flow 'volume_create_manager' (d54b64a4-c544-43b9-b7ca-904cb5e73590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe783996-7a2d-4c94-9526-b31e4418dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe783996-7a2d-4c94-9526-b31e4418dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1198241522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b859996-f440-4a47-abe1-b51aebe87218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eb2aa153b64013bdca21a389e9c72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:52:37Z,use_quota=True,user_id='690fb8cb08994c17bfa785c70d3b21aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544227de-4131-417f-8f4e-362bf06ccdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544227de-4131-417f-8f4e-362bf06ccdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283ec5d2-e1ea-4385-8152-93d94fdcd549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283ec5d2-e1ea-4385-8152-93d94fdcd549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b859996-f440-4a47-abe1-b51aebe87218', 'volume_name': 'volume-9b859996-f440-4a47-abe1-b51aebe87218', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c110693-4957-4240-9918-b2dd8c905274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c110693-4957-4240-9918-b2dd8c905274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ba022-2155-417a-8493-7986a5b592a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:52:37 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Volume 9b859996-f440-4a47-abe1-b51aebe87218: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b859996-f440-4a47-abe1-b51aebe87218', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 13:52:37 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Cloning 9b859996-f440-4a47-abe1-b51aebe87218 from image 63abeada-c2a5-416e-b79d-1e59204999db at location (None, None). {{(pid=83206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 13:52:38 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 13:52:38 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Image download 20.69 MB at 20.69 MB/s Sep 10 13:52:38 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe4ded6-cdfa-4bce-ae66-9d3a1fc866a2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:52:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:38 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD Sep 10 13:52:38 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:52:40 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 10 13:52:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD" returned: 0 in 1.992s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:40 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db is fetched for user 690fb8cb08994c17bfa785c70d3b21aa. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 13:52:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de16ff9-b7d8-4d3e-9782-a3e5707b5cd9]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:52:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:41 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD Sep 10 13:52:41 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:52:42 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD" returned: 0 in 2.064s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1198241522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b859996-f440-4a47-abe1-b51aebe87218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eb2aa153b64013bdca21a389e9c72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:52:37Z,use_quota=True,user_id='690fb8cb08994c17bfa785c70d3b21aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Creating volume 9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:52:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:52:43 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:43 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=109, name=volume-9b859996-f440-4a47-abe1-b51aebe87218, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 1073741824" returned: 0 in 0.385s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 0 in 0.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] <== create_volume: return (588ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.625s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Attempting download of 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume 9b859996-f440-4a47-abe1-b51aebe87218. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc6ed4-e369-4e3c-8fca-30d6f7b6abd5]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:52:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_zjyz0fuq {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_zjyz0fuq" returned: 0 in 0.357s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_zjyz0fuq {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_zjyz0fuq" returned: 1 in 0.401s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_zjyz0fuq' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:52:44 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f03241-4655-4b02-b3e6-1708176d5cfa]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:52:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:45 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] 63abeada-c2a5-416e-b79d-1e59204999db was qcow2, converting to raw {{(pid=83206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 13:52:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:45 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=109, name=volume-9b859996-f440-4a47-abe1-b51aebe87218, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:52:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 0 in 1.404s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:46 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_zf4gpg5cdevstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:52:46 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Converted 112.00 MB image at 77.98 MB/s Sep 10 13:52:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 1G" returned: 0 in 0.190s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:47 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6f2fb7-04fc-401d-bbcc-8beef32d35d5]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:52:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 0 in 0.431s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:48 devstack quobyte-client[83260]: System call of process 97573 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 1 in 0.486s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Downloaded image 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume 9b859996-f440-4a47-abe1-b51aebe87218 successfully. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db for user 690fb8cb08994c17bfa785c70d3b21aa is deleted. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Marking volume 9b859996-f440-4a47-abe1-b51aebe87218 as bootable. {{(pid=83206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Copying metadata from image 63abeada-c2a5-416e-b79d-1e59204999db to 9b859996-f440-4a47-abe1-b51aebe87218. {{(pid=83206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Creating volume glance metadata for volume 9b859996-f440-4a47-abe1-b51aebe87218 backed by image 63abeada-c2a5-416e-b79d-1e59204999db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ba022-2155-417a-8493-7986a5b592a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b859996-f440-4a47-abe1-b51aebe87218', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1ec3c6-594d-439f-ac82-428f7f1f71ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:52:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Volume volume-9b859996-f440-4a47-abe1-b51aebe87218 (9b859996-f440-4a47-abe1-b51aebe87218): created successfully Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1ec3c6-594d-439f-ac82-428f7f1f71ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:52:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Flow 'volume_create_manager' (d54b64a4-c544-43b9-b7ca-904cb5e73590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:52:48 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a87a5023-5e58-4ece-9926-735055f6729b tempest-TestShelveInstance-1624939866 None] Created volume successfully. Sep 10 13:52:58 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:INSERT=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:52:58 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7,cinder:INSERT=9,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:52:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:52:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:52:58 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30bc6f-8416-49d0-8540-9531aeeebcda]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:52:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:52:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 0 in 0.707s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:52:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:53:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 1 in 0.595s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:53:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:53:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.504s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:53:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-9b859996-f440-4a47-abe1-b51aebe87218', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c16abb9-96ee-4103-b77f-22a2466d6699', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:53:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:53:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-2e32c116-6565-4510-90ee-27e553351653 req-2343a5d7-aaf3-4559-b49b-de7586db878b tempest-TestShelveInstance-1624939866 None] attachment_update completed successfully. Sep 10 13:53:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Flow 'volume_create_manager' (e0d97c08-872d-44d8-a4df-7d4dc3950b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8275f930-d949-4156-af23-167342b5aa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8275f930-d949-4156-af23-167342b5aa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-542815639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd732a0-c286-4c0c-90b6-f0d16027a5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af3ee7d0f04eeead60ced4aea992e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:53:08Z,use_quota=True,user_id='5e822f7052244097952fbbfa1ec7ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d96319-61f7-414c-a050-d5710fafbd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d96319-61f7-414c-a050-d5710fafbd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3f31bd-8fe3-47b7-874f-78b0b46e0a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3f31bd-8fe3-47b7-874f-78b0b46e0a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd732a0-c286-4c0c-90b6-f0d16027a5fc', 'volume_name': 'volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e79423-088a-49ca-bdb5-5d5aca02676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e79423-088a-49ca-bdb5-5d5aca02676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d411d34-acc5-4a0c-abff-77dd93f879f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:53:07 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Volume 5fd732a0-c286-4c0c-90b6-f0d16027a5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc', 'volume_size': 1} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-542815639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd732a0-c286-4c0c-90b6-f0d16027a5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af3ee7d0f04eeead60ced4aea992e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:53:08Z,use_quota=True,user_id='5e822f7052244097952fbbfa1ec7ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Creating volume 5fd732a0-c286-4c0c-90b6-f0d16027a5fc {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:53:07 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:53:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:53:08 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=110, name=volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc 1073741824" returned: 0 in 0.510s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc" returned: 0 in 0.116s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] <== create_volume: return (692ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d411d34-acc5-4a0c-abff-77dd93f879f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694ac642-3f6c-4107-913a-fadcb4996d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:53:08 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Volume volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc (5fd732a0-c286-4c0c-90b6-f0d16027a5fc): created successfully Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694ac642-3f6c-4107-913a-fadcb4996d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:53:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Flow 'volume_create_manager' (e0d97c08-872d-44d8-a4df-7d4dc3950b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:53:08 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0b0fdc59-4877-4e5f-bed5-d703cc934bb7 tempest-AttachVolumeNegativeTest-1038137060 None] Created volume successfully. Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.060s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.286s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:53:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:53:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:53:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:53:14 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf5d73-a8ad-4202-9c6f-aa7a0f789258]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:53:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:53:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc" returned: 0 in 0.561s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:53:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:53:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8586041e-55b7-41dc-9c7b-5ec043303de9', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:53:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:53:15 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-c8022ded-0ed1-42fb-8eb0-8431a1740376 req-27a2885e-44a4-4091-82d0-e5533f436cfb tempest-AttachVolumeNegativeTest-1038137060 None] attachment_update completed successfully. Sep 10 13:53:25 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:53:25 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:53:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-44c369ad-0e25-427d-b6f8-325789dd98ee req-a66bada7-a7b3-4552-92d5-7a5b77d78d95 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:53:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-44c369ad-0e25-427d-b6f8-325789dd98ee req-a66bada7-a7b3-4552-92d5-7a5b77d78d95 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:53:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-44c369ad-0e25-427d-b6f8-325789dd98ee req-a66bada7-a7b3-4552-92d5-7a5b77d78d95 tempest-AttachVolumeNegativeTest-1038137060 None] Terminate volume connection completed successfully. Sep 10 13:53:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-44c369ad-0e25-427d-b6f8-325789dd98ee req-a66bada7-a7b3-4552-92d5-7a5b77d78d95 tempest-AttachVolumeNegativeTest-1038137060 None] Deleting attachment 8586041e-55b7-41dc-9c7b-5ec043303de9. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:53:56 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:53:56 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.192s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:54:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:54:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:54:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:54:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-df89699c-c665-443a-b312-f8586ed9c989 req-cd71d3f6-1331-44aa-a11d-90432aa6f79e tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:54:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-df89699c-c665-443a-b312-f8586ed9c989 req-cd71d3f6-1331-44aa-a11d-90432aa6f79e tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:54:40 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-df89699c-c665-443a-b312-f8586ed9c989 req-cd71d3f6-1331-44aa-a11d-90432aa6f79e tempest-TestShelveInstance-1624939866 None] Terminate volume connection completed successfully. Sep 10 13:54:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-df89699c-c665-443a-b312-f8586ed9c989 req-cd71d3f6-1331-44aa-a11d-90432aa6f79e tempest-TestShelveInstance-1624939866 None] Deleting attachment 7c16abb9-96ee-4103-b77f-22a2466d6699. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:54:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:54:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:54:47 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[361e2fa0-d65a-4d74-bea6-8bfa015b3892]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:54:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:54:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 0 in 0.518s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:54:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:54:48 devstack quobyte-client[83260]: System call of process 98461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:54:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 1 in 0.412s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:54:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:54:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.191s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:54:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-9b859996-f440-4a47-abe1-b51aebe87218', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd70bfee8-9935-488b-b090-b8fe0ed97a73', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:54:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:54:49 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-54337e39-e11f-4372-892d-c7cde2d8ffe5 req-e4260a02-5e39-428c-b315-1127cfc77947 tempest-TestShelveInstance-1624939866 None] attachment_update completed successfully. Sep 10 13:54:59 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:54:59 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.115s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:55:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:55:39 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:55:39 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Flow 'volume_create_manager' (638ade02-2e41-408d-adb8-06eee6edd52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d10971-4bdf-4242-b09a-547cecc8c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d10971-4bdf-4242-b09a-547cecc8c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-555428026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fb9dbd-0304-4276-96bd-9947521536ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af3ee7d0f04eeead60ced4aea992e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:55:40Z,use_quota=True,user_id='5e822f7052244097952fbbfa1ec7ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4026cb47-b319-40c8-b892-d10c7d3d1959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4026cb47-b319-40c8-b892-d10c7d3d1959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279aa7da-495b-42ca-be32-27cdfa75e505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279aa7da-495b-42ca-be32-27cdfa75e505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fb9dbd-0304-4276-96bd-9947521536ac', 'volume_name': 'volume-a5fb9dbd-0304-4276-96bd-9947521536ac', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240e2762-052a-4fb8-b749-7be76d384a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240e2762-052a-4fb8-b749-7be76d384a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3b7c40-1313-46d1-aeab-60d056e38cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:55:40 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Volume a5fb9dbd-0304-4276-96bd-9947521536ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fb9dbd-0304-4276-96bd-9947521536ac', 'volume_size': 1} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-555428026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fb9dbd-0304-4276-96bd-9947521536ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af3ee7d0f04eeead60ced4aea992e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:55:40Z,use_quota=True,user_id='5e822f7052244097952fbbfa1ec7ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Creating volume a5fb9dbd-0304-4276-96bd-9947521536ac {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:55:40 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:55:40 devstack quobyte-client[83260]: System call of process 99281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:55:40 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=111, name=volume-a5fb9dbd-0304-4276-96bd-9947521536ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac 1073741824" returned: 0 in 0.400s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac" returned: 0 in 0.148s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] <== create_volume: return (640ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3b7c40-1313-46d1-aeab-60d056e38cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fb9dbd-0304-4276-96bd-9947521536ac', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:55:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08b6552-d082-4c4d-a26f-b6377e95ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:55:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Volume volume-a5fb9dbd-0304-4276-96bd-9947521536ac (a5fb9dbd-0304-4276-96bd-9947521536ac): created successfully Sep 10 13:55:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08b6552-d082-4c4d-a26f-b6377e95ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:55:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Flow 'volume_create_manager' (638ade02-2e41-408d-adb8-06eee6edd52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:55:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b44551f0-a1b2-4666-8d0a-2d6fb3aea427 tempest-AttachVolumeNegativeTest-1038137060 None] Created volume successfully. Sep 10 13:55:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:55:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:55:45 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[629df420-8498-4cb1-af0b-450daa8bbd65]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:55:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:55:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac" returned: 0 in 0.492s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:55:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.566s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:55:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-a5fb9dbd-0304-4276-96bd-9947521536ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01a26dd7-42bc-4ecf-91ac-e52b20efcab2', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 13:55:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:55:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-a29c26c8-d0c1-434f-9308-e9c9cb9550dc req-d0fd9263-401e-49e9-89c6-d39d26e0e65e tempest-AttachVolumeNegativeTest-1038137060 None] attachment_update completed successfully. Sep 10 13:55:56 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:55:56 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.101s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:56:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-18d08c23-6774-4ffc-a06f-bd6c5d2737f4 req-8fade057-9aff-4359-ad5b-fd3716361df4 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:14 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-18d08c23-6774-4ffc-a06f-bd6c5d2737f4 req-8fade057-9aff-4359-ad5b-fd3716361df4 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-18d08c23-6774-4ffc-a06f-bd6c5d2737f4 req-8fade057-9aff-4359-ad5b-fd3716361df4 tempest-AttachVolumeNegativeTest-1038137060 None] Terminate volume connection completed successfully. Sep 10 13:56:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-18d08c23-6774-4ffc-a06f-bd6c5d2737f4 req-8fade057-9aff-4359-ad5b-fd3716361df4 tempest-AttachVolumeNegativeTest-1038137060 None] Deleting attachment 01a26dd7-42bc-4ecf-91ac-e52b20efcab2. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:56:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:56:24 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=3 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:56:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-c9c432d7-f394-4ea1-8299-71e0518799c8 tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-c9c432d7-f394-4ea1-8299-71e0518799c8 tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-c9c432d7-f394-4ea1-8299-71e0518799c8 tempest-TestShelveInstance-1624939866 None] Terminate volume connection completed successfully. Sep 10 13:56:27 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-c9c432d7-f394-4ea1-8299-71e0518799c8 tempest-TestShelveInstance-1624939866 None] Deleting attachment d70bfee8-9935-488b-b090-b8fe0ed97a73. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 13:56:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Acquiring lock "cinder-9b859996-f440-4a47-abe1-b51aebe87218-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Lock "cinder-9b859996-f440-4a47-abe1-b51aebe87218-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:28 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Acquiring lock "cinder-quobyte-9b859996-f440-4a47-abe1-b51aebe87218" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Lock "cinder-quobyte-9b859996-f440-4a47-abe1-b51aebe87218" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:28 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14748a-23ba-4d26-847f-f70a7464e1c3]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:56:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 0 in 0.521s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 1 in 0.464s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:56:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9b859996-f440-4a47-abe1-b51aebe87218" returned: 0 in 0.123s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Lock "cinder-quobyte-9b859996-f440-4a47-abe1-b51aebe87218" released by "delete_volume" :: held 1.427s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG cinder.quota [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Created reservations ['a40c381d-c35e-438d-8e06-44463164a793', 'ca84253a-55e0-4108-a52e-49fdcc878b18', '3440c986-f274-46f8-bf6f-9d7dd1c45dee', 'a987bb0a-0390-4c02-8125-ce547267949d'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "cinder-a5fb9dbd-0304-4276-96bd-9947521536ac-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.439s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG cinder.manager [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-a5fb9dbd-0304-4276-96bd-9947521536ac-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Deleted volume successfully. Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [req-a85bcb61-24f3-4346-8518-05cc0695a1a7 req-00d83517-d72b-4b41-9c26-2a29912f671d tempest-TestShelveInstance-1624939866 None] Lock "cinder-9b859996-f440-4a47-abe1-b51aebe87218-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "cinder-quobyte-a5fb9dbd-0304-4276-96bd-9947521536ac" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-quobyte-a5fb9dbd-0304-4276-96bd-9947521536ac" acquired by "delete_volume" :: waited 0.042s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c411ae-eef4-4750-884b-b00bf8f633f0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:56:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac" returned: 0 in 0.728s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-a5fb9dbd-0304-4276-96bd-9947521536ac" returned: 0 in 0.159s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-quobyte-a5fb9dbd-0304-4276-96bd-9947521536ac" released by "delete_volume" :: held 1.096s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:32 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Created reservations ['e52182e4-dfbb-43d9-a234-bf28ccc55e09', '980cb858-d9a2-48f8-a10b-b27b0fee1175', 'ec89810f-572f-4015-b421-d26f0fa2a828', '142cb7b1-b826-4852-badb-a24b0d88c1d4'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.096s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:56:33 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Deleted volume successfully. Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ff0983f2-ef75-467d-86cc-7279b73692b4 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-a5fb9dbd-0304-4276-96bd-9947521536ac-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "cinder-5fd732a0-c286-4c0c-90b6-f0d16027a5fc-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-5fd732a0-c286-4c0c-90b6-f0d16027a5fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "cinder-quobyte-5fd732a0-c286-4c0c-90b6-f0d16027a5fc" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-quobyte-5fd732a0-c286-4c0c-90b6-f0d16027a5fc" acquired by "delete_volume" :: waited 0.017s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c6cbaa-b557-4229-94c2-03ad449ff0da]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:56:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc" returned: 0 in 0.595s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5fd732a0-c286-4c0c-90b6-f0d16027a5fc" returned: 0 in 0.201s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-quobyte-5fd732a0-c286-4c0c-90b6-f0d16027a5fc" released by "delete_volume" :: held 1.129s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Created reservations ['3fe53ff5-b933-4eae-b9ae-2a4c94c00cba', 'e8ae9add-3a3d-4f7e-a147-32ce7a80b161', '9c234e76-9ab4-4072-a20b-6ea69ff3bbf4', '3932b7c1-d228-491d-bc67-8846551bfda7'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:35 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:56:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Deleted volume successfully. Sep 10 13:56:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-62a05ba1-d7c4-4134-94c6-c7a24902ad8a tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-5fd732a0-c286-4c0c-90b6-f0d16027a5fc-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "cinder-ffaa988a-4387-4b0e-99f0-be39e6810f2b-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-ffaa988a-4387-4b0e-99f0-be39e6810f2b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:36 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "cinder-quobyte-ffaa988a-4387-4b0e-99f0-be39e6810f2b" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:56:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-quobyte-ffaa988a-4387-4b0e-99f0-be39e6810f2b" acquired by "delete_volume" :: waited 0.037s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:56:36 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4726d208-1336-40c7-8513-f03f68122049]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:56:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b" returned: 0 in 0.538s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ffaa988a-4387-4b0e-99f0-be39e6810f2b" returned: 0 in 0.135s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-quobyte-ffaa988a-4387-4b0e-99f0-be39e6810f2b" released by "delete_volume" :: held 0.872s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Created reservations ['096f2e4a-c267-43ae-9c65-899961ac7e95', 'fc1a6bb5-0d5e-4bfe-a50a-7ffe70efb949', '96416c6d-5b6d-4b31-aaa4-dd14d6cebad5', 'acf6a8e4-d7df-4e38-a477-511f83090dd7'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.167s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:56:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Deleted volume successfully. Sep 10 13:56:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-3205587c-65da-4cd3-bf18-ba4ccbe442b1 tempest-AttachVolumeNegativeTest-1038137060 None] Lock "cinder-ffaa988a-4387-4b0e-99f0-be39e6810f2b-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:56:48 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=18,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:56:48 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=24,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:56:52 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Flow 'volume_create_manager' (5e86ae26-1836-4fcf-a266-df1a21e054a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ec9d4d-4059-4567-baa5-b02d6d14c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ec9d4d-4059-4567-baa5-b02d6d14c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-809043655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d067dbab-051a-4024-9ac5-336e9f12f0c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b697280e5834055baf1c7e64d76e0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:53Z,use_quota=True,user_id='f44eafa3be5643cb9e9f52af57fb433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c91b22a-35a6-4838-bd86-86f0015bfeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c91b22a-35a6-4838-bd86-86f0015bfeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e05510d-a127-45f8-ab6e-69836feb9c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e05510d-a127-45f8-ab6e-69836feb9c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd067dbab-051a-4024-9ac5-336e9f12f0c8', 'volume_name': 'volume-d067dbab-051a-4024-9ac5-336e9f12f0c8', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf322eb-0d12-411b-8606-14bc2aeb9cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf322eb-0d12-411b-8606-14bc2aeb9cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e35fa6-e125-40a5-9945-11abc357deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:52 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Volume d067dbab-051a-4024-9ac5-336e9f12f0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d067dbab-051a-4024-9ac5-336e9f12f0c8', 'volume_size': 1} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-809043655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d067dbab-051a-4024-9ac5-336e9f12f0c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b697280e5834055baf1c7e64d76e0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:53Z,use_quota=True,user_id='f44eafa3be5643cb9e9f52af57fb433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Creating volume d067dbab-051a-4024-9ac5-336e9f12f0c8 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:56:53 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:53 devstack quobyte-client[83260]: System call of process 99505 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:56:53 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=112, name=volume-d067dbab-051a-4024-9ac5-336e9f12f0c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8 1073741824" returned: 0 in 0.427s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8" returned: 0 in 0.149s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] <== create_volume: return (665ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e35fa6-e125-40a5-9945-11abc357deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d067dbab-051a-4024-9ac5-336e9f12f0c8', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc1a931-b1c0-4de0-8f83-1cec971ad09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:53 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Volume volume-d067dbab-051a-4024-9ac5-336e9f12f0c8 (d067dbab-051a-4024-9ac5-336e9f12f0c8): created successfully Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc1a931-b1c0-4de0-8f83-1cec971ad09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Flow 'volume_create_manager' (5e86ae26-1836-4fcf-a266-df1a21e054a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f7883bf1-444c-4150-9a6e-1026bf946fc6 tempest-VolumesTestJSON-99402841 None] Created volume successfully. Sep 10 13:56:54 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Flow 'volume_create_manager' (d22a4805-c159-491d-9828-d9a525806635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed728987-8cf5-4644-bd0c-977fbda47a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed728987-8cf5-4644-bd0c-977fbda47a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385b04f1-5923-4eb4-9906-513b0dc61117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c2a6ec389b4ab58be7709ec7a32e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:55Z,use_quota=True,user_id='d5389ba9cf8c4e679cf1d14f04bd9ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90072c8-a2ed-4c4d-9d7f-c8ec057905be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90072c8-a2ed-4c4d-9d7f-c8ec057905be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da10f55d-1ec2-47ba-9721-b572a2fbf02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da10f55d-1ec2-47ba-9721-b572a2fbf02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385b04f1-5923-4eb4-9906-513b0dc61117', 'volume_name': 'volume-385b04f1-5923-4eb4-9906-513b0dc61117', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807d9b18-2325-4ca4-a94e-5de46efa90ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807d9b18-2325-4ca4-a94e-5de46efa90ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f327b3c-b666-40e8-abf4-be67391b6f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:54 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Volume 385b04f1-5923-4eb4-9906-513b0dc61117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385b04f1-5923-4eb4-9906-513b0dc61117', 'volume_size': 1} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385b04f1-5923-4eb4-9906-513b0dc61117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c2a6ec389b4ab58be7709ec7a32e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:55Z,use_quota=True,user_id='d5389ba9cf8c4e679cf1d14f04bd9ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Creating volume 385b04f1-5923-4eb4-9906-513b0dc61117 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:56:54 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:56:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:55 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=113, name=volume-385b04f1-5923-4eb4-9906-513b0dc61117, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117 1073741824" returned: 0 in 0.410s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117" returned: 0 in 0.158s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f327b3c-b666-40e8-abf4-be67391b6f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385b04f1-5923-4eb4-9906-513b0dc61117', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adce5c8f-e3fa-4ae1-8bfe-f4d81c7e54e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:55 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Flow 'volume_create_manager' (bc727f4f-95bc-49fd-a624-8e942cf5afc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796bb700-913f-4115-8604-b1491f4548cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:56 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Volume volume-385b04f1-5923-4eb4-9906-513b0dc61117 (385b04f1-5923-4eb4-9906-513b0dc61117): created successfully Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adce5c8f-e3fa-4ae1-8bfe-f4d81c7e54e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Flow 'volume_create_manager' (d22a4805-c159-491d-9828-d9a525806635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796bb700-913f-4115-8604-b1491f4548cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-345707955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b551f818-7da8-4d3e-9b6b-2fe614ac9357,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b697280e5834055baf1c7e64d76e0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:56Z,use_quota=True,user_id='f44eafa3be5643cb9e9f52af57fb433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40004eee-e30d-4635-8011-43be0f075798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40004eee-e30d-4635-8011-43be0f075798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c028fb-4bac-4916-91ed-61fd4914bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c028fb-4bac-4916-91ed-61fd4914bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b551f818-7da8-4d3e-9b6b-2fe614ac9357', 'volume_name': 'volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bc59dd-1a45-4090-ac69-bdb66f9e1ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bc59dd-1a45-4090-ac69-bdb66f9e1ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9581abc-49bc-47b7-a2af-a2ab9fefedda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:56 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Volume b551f818-7da8-4d3e-9b6b-2fe614ac9357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357', 'volume_size': 1} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-345707955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b551f818-7da8-4d3e-9b6b-2fe614ac9357,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b697280e5834055baf1c7e64d76e0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:56Z,use_quota=True,user_id='f44eafa3be5643cb9e9f52af57fb433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Creating volume b551f818-7da8-4d3e-9b6b-2fe614ac9357 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:56:56 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:56 devstack quobyte-client[83260]: System call of process 99513 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:56:56 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=114, name=volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:56:56 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-24bdf7db-e677-49d8-96fb-2449c46693a2 tempest-CinderUnicodeTest-1541754757 None] Created volume successfully. Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357 1073741824" returned: 0 in 0.384s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357" returned: 0 in 0.145s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] <== create_volume: return (568ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9581abc-49bc-47b7-a2af-a2ab9fefedda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1d3894-0c42-42cd-9bf2-94947adfa94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:56 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Volume volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357 (b551f818-7da8-4d3e-9b6b-2fe614ac9357): created successfully Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1d3894-0c42-42cd-9bf2-94947adfa94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Flow 'volume_create_manager' (bc727f4f-95bc-49fd-a624-8e942cf5afc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-aa9e1852-94ea-4586-8057-224176f6ef51 tempest-VolumesTestJSON-99402841 None] Created volume successfully. Sep 10 13:56:57 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Flow 'volume_create_manager' (4b34986a-4070-45fe-92b3-953e05350bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16036b1-9f4b-49dc-a50a-dfa47bb25c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16036b1-9f4b-49dc-a50a-dfa47bb25c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1166524766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d06500-d2e9-431d-95b1-bade655f0535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c2a6ec389b4ab58be7709ec7a32e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:57Z,use_quota=True,user_id='d5389ba9cf8c4e679cf1d14f04bd9ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf403d6-b9f0-4e78-b70e-d33753509105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf403d6-b9f0-4e78-b70e-d33753509105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:57 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e17cd52-586a-4aa8-8f8c-d7ea41251e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e17cd52-586a-4aa8-8f8c-d7ea41251e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d06500-d2e9-431d-95b1-bade655f0535', 'volume_name': 'volume-81d06500-d2e9-431d-95b1-bade655f0535', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2444c45b-c99e-462d-9b20-5a8f34cd8bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2444c45b-c99e-462d-9b20-5a8f34cd8bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab169481-0609-4099-98c4-b4e338537f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:58 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Volume 81d06500-d2e9-431d-95b1-bade655f0535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d06500-d2e9-431d-95b1-bade655f0535', 'volume_size': 1} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1166524766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d06500-d2e9-431d-95b1-bade655f0535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c2a6ec389b4ab58be7709ec7a32e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:57Z,use_quota=True,user_id='d5389ba9cf8c4e679cf1d14f04bd9ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Creating volume 81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:56:58 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:58 devstack quobyte-client[83260]: System call of process 99517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:56:58 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=115, name=volume-81d06500-d2e9-431d-95b1-bade655f0535, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 1073741824" returned: 0 in 0.804s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:58 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Flow 'volume_create_manager' (b3eaa6d7-ed58-4e83-ab6e-9efd8db1cb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a496bea-bc4f-4563-9eff-c2c0e246b6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535" returned: 0 in 0.397s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] <== create_volume: return (1228ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a496bea-bc4f-4563-9eff-c2c0e246b6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-833234572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e20d98c-da8d-4507-a436-9f97f30416fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b697280e5834055baf1c7e64d76e0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:58Z,use_quota=True,user_id='f44eafa3be5643cb9e9f52af57fb433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad40fe-3a84-4f1f-b7b6-76a61a07ab79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad40fe-3a84-4f1f-b7b6-76a61a07ab79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e830ca9-ab32-4a21-94ff-b19b4008b63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e830ca9-ab32-4a21-94ff-b19b4008b63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e20d98c-da8d-4507-a436-9f97f30416fc', 'volume_name': 'volume-4e20d98c-da8d-4507-a436-9f97f30416fc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da797048-8252-482d-8183-3bb9d823b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da797048-8252-482d-8183-3bb9d823b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71a9e46-eaf5-4025-b4ed-3fc6364ccdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:59 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Volume 4e20d98c-da8d-4507-a436-9f97f30416fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e20d98c-da8d-4507-a436-9f97f30416fc', 'volume_size': 1} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-833234572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e20d98c-da8d-4507-a436-9f97f30416fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b697280e5834055baf1c7e64d76e0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:56:58Z,use_quota=True,user_id='f44eafa3be5643cb9e9f52af57fb433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Creating volume 4e20d98c-da8d-4507-a436-9f97f30416fc {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:56:59 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:56:59 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=116, name=volume-4e20d98c-da8d-4507-a436-9f97f30416fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab169481-0609-4099-98c4-b4e338537f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d06500-d2e9-431d-95b1-bade655f0535', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d739de4-24b4-4511-a4d1-58602aaf4635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:56:59 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Volume volume-81d06500-d2e9-431d-95b1-bade655f0535 (81d06500-d2e9-431d-95b1-bade655f0535): created successfully Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d739de4-24b4-4511-a4d1-58602aaf4635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Flow 'volume_create_manager' (4b34986a-4070-45fe-92b3-953e05350bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc 1073741824" returned: 0 in 0.515s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:56:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0043292a-4829-4c48-911f-7a106fefc440 tempest-CinderUnicodeTest-1541754757 None] Created volume successfully. Sep 10 13:57:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc" returned: 0 in 0.277s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] <== create_volume: return (812ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:57:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71a9e46-eaf5-4025-b4ed-3fc6364ccdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e20d98c-da8d-4507-a436-9f97f30416fc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c13754-3ebd-4818-9da8-bb4a21efe1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:00 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Volume volume-4e20d98c-da8d-4507-a436-9f97f30416fc (4e20d98c-da8d-4507-a436-9f97f30416fc): created successfully Sep 10 13:57:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c13754-3ebd-4818-9da8-bb4a21efe1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Flow 'volume_create_manager' (b3eaa6d7-ed58-4e83-ab6e-9efd8db1cb4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:00 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a18ed07f-5e50-40ab-8abf-0c8ddcc86fa6 tempest-VolumesTestJSON-99402841 None] Created volume successfully. Sep 10 13:57:01 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Creating offline snapshot 65d80460-c995-4191-81b1-cb0d9df8d3ad of volume 81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:57:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Acquiring lock "cinder-4e20d98c-da8d-4507-a436-9f97f30416fc-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:01 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[571a273c-ec88-4e15-8488-f78549274e36]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Lock "cinder-4e20d98c-da8d-4507-a436-9f97f30416fc-delete_volume" acquired by "delete_volume" :: waited 0.266s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:02 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Acquiring lock "cinder-quobyte-4e20d98c-da8d-4507-a436-9f97f30416fc" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Lock "cinder-quobyte-4e20d98c-da8d-4507-a436-9f97f30416fc" acquired by "delete_volume" :: waited 0.021s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535" returned: 0 in 0.622s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc976d1c-d60d-4dbd-af1c-26506ba7b16f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:02 devstack quobyte-client[83260]: System call of process 99529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:02 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=117, name=volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad 1G" returned: 0 in 0.309s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): qemu-img rebase -u -b volume-81d06500-d2e9-431d-95b1-bade655f0535 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] CMD "qemu-img rebase -u -b volume-81d06500-d2e9-431d-95b1-bade655f0535 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad" returned: 0 in 0.212s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad" returned: 0 in 0.120s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc" returned: 0 in 0.687s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad" returned: 0 in 0.171s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4e20d98c-da8d-4507-a436-9f97f30416fc" returned: 0 in 0.275s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.info" returned: 0 in 0.209s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Lock "cinder-quobyte-4e20d98c-da8d-4507-a436-9f97f30416fc" released by "delete_volume" :: held 1.380s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.info" returned: 0 in 0.301s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:04 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f42adb38-c6c7-477e-91a4-1b598949b6fc tempest-CinderUnicodeTest-1541754757 None] Create snapshot completed successfully Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Created reservations ['7af1c258-91d2-4c20-b473-8bb6899e0279', 'd511f770-8426-45d9-b79f-e72e05cb6f25', '4c8a251c-9886-4615-af7f-f89c0d529618', 'b9441dac-0913-41ac-8d32-97cad8f898c4'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:04 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "cinder-65d80460-c995-4191-81b1-cb0d9df8d3ad-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Deleted volume successfully. Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-65d80460-c995-4191-81b1-cb0d9df8d3ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.215s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "cinder-quobyte-81d06500-d2e9-431d-95b1-bade655f0535" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-18ce8ac7-4acc-49af-9280-ff487d9909e4 tempest-VolumesTestJSON-99402841 None] Lock "cinder-4e20d98c-da8d-4507-a436-9f97f30416fc-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-81d06500-d2e9-431d-95b1-bade655f0535" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "cinder-quobyte-65d80460-c995-4191-81b1-cb0d9df8d3ad" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-65d80460-c995-4191-81b1-cb0d9df8d3ad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Deleting offline snapshot 65d80460-c995-4191-81b1-cb0d9df8d3ad of volume 81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] snapshot_file for this snap is: volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[39698925-e020-449c-97ca-601be0928103]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Acquiring lock "cinder-b551f818-7da8-4d3e-9b6b-2fe614ac9357-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Lock "cinder-b551f818-7da8-4d3e-9b6b-2fe614ac9357-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:06 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Acquiring lock "cinder-quobyte-b551f818-7da8-4d3e-9b6b-2fe614ac9357" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad" returned: 0 in 0.620s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81d06500-d2e9-431d-95b1-bade655f0535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbae811-87e5-442c-9fc4-dec994995d4e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Lock "cinder-quobyte-b551f818-7da8-4d3e-9b6b-2fe614ac9357" acquired by "delete_volume" :: waited 0.168s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31efb8c-d902-47ed-8d44-3360e9740526]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535" returned: 0 in 0.574s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357" returned: 0 in 0.578s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b551f818-7da8-4d3e-9b6b-2fe614ac9357" returned: 0 in 0.118s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Lock "cinder-quobyte-b551f818-7da8-4d3e-9b6b-2fe614ac9357" released by "delete_volume" :: held 0.971s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad" returned: 0 in 0.515s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535.65d80460-c995-4191-81b1-cb0d9df8d3ad" returned: 0 in 0.224s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-65d80460-c995-4191-81b1-cb0d9df8d3ad" released by "_delete_snapshot" :: held 2.227s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-81d06500-d2e9-431d-95b1-bade655f0535" released by "delete_snapshot" :: held 2.256s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Created reservations ['797dd2ce-5c62-427c-854c-eceb46b062d7', '0c825182-8828-4a27-9705-d0b44efea73a', '32a6b208-d6e5-4bc4-b58c-3969c055ebe6', 'b412768c-712a-4d5f-bb9f-f911e96081c1'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Created reservations ['bd3544a9-b505-4291-8880-2b4e3feeb0a4', '2678bf49-21a7-4a9b-ad1d-fd403f8f80d6', '989df0f0-4248-4b11-b21e-39eed3840b91', 'bd8c9365-f50b-4287-bdda-222fc68abf72'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:57:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.234s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:57:08 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Deleted volume successfully. Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "cinder-81d06500-d2e9-431d-95b1-bade655f0535-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-81d06500-d2e9-431d-95b1-bade655f0535-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:08 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Delete snapshot completed successfully. Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f75aba92-857c-45b4-88be-7de8a124e8a6 tempest-VolumesTestJSON-99402841 None] Lock "cinder-b551f818-7da8-4d3e-9b6b-2fe614ac9357-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-fdea0c5e-1a54-4946-b8dc-0b0ea03f7a19 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-65d80460-c995-4191-81b1-cb0d9df8d3ad-delete_snapshot" released by "delete_snapshot" :: held 3.323s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:08 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "cinder-quobyte-81d06500-d2e9-431d-95b1-bade655f0535" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-81d06500-d2e9-431d-95b1-bade655f0535" acquired by "delete_volume" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe23bac8-fbdd-43cc-a967-1d157ca8cb49]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Acquiring lock "cinder-d067dbab-051a-4024-9ac5-336e9f12f0c8-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Lock "cinder-d067dbab-051a-4024-9ac5-336e9f12f0c8-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535" returned: 0 in 0.671s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-81d06500-d2e9-431d-95b1-bade655f0535" returned: 0 in 0.479s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:10 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Acquiring lock "cinder-quobyte-d067dbab-051a-4024-9ac5-336e9f12f0c8" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-81d06500-d2e9-431d-95b1-bade655f0535" released by "delete_volume" :: held 1.415s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Lock "cinder-quobyte-d067dbab-051a-4024-9ac5-336e9f12f0c8" acquired by "delete_volume" :: waited 0.145s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201b758-4f90-435e-936f-33d909865a8f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Created reservations ['77e50de1-d8cb-45a7-83ec-f5c93fdd0024', '295050b9-8d34-4218-9ba6-e14f51ac1f85', '44604c69-e097-4f83-90f4-99078137a693', 'e448300a-6da6-406f-92c0-3dd3a43f9061'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8" returned: 0 in 0.848s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.232s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:57:11 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Deleted volume successfully. Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d067dbab-051a-4024-9ac5-336e9f12f0c8" returned: 0 in 0.339s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Lock "cinder-quobyte-d067dbab-051a-4024-9ac5-336e9f12f0c8" released by "delete_volume" :: held 1.584s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-9553d0a5-e52d-43c7-b3d5-8bac08b94576 tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-81d06500-d2e9-431d-95b1-bade655f0535-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "cinder-385b04f1-5923-4eb4-9906-513b0dc61117-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.526s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-385b04f1-5923-4eb4-9906-513b0dc61117-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:12 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "cinder-quobyte-385b04f1-5923-4eb4-9906-513b0dc61117" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-385b04f1-5923-4eb4-9906-513b0dc61117" acquired by "delete_volume" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Created reservations ['098fd2ca-10b6-41bb-9806-5faf84f6a46f', 'b8cdae63-1506-4e27-9001-c22dc3dbdcb8', 'f57af628-ef1d-4f7a-989f-e03f8e24da52', '2d64eeb9-cf24-49ac-962e-9178c4a12895'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[223b1cb3-8e03-4da3-8a90-5262c95968dc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117" returned: 0 in 0.699s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.264s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:57:13 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Deleted volume successfully. Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-385b04f1-5923-4eb4-9906-513b0dc61117" returned: 0 in 0.392s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-quobyte-385b04f1-5923-4eb4-9906-513b0dc61117" released by "delete_volume" :: held 1.279s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-ad507315-3eee-41aa-88b3-95e7cf6a7963 tempest-VolumesTestJSON-99402841 None] Lock "cinder-d067dbab-051a-4024-9ac5-336e9f12f0c8-delete_volume" released by "delete_volume" :: held 4.297s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Created reservations ['9ec40842-a795-4017-b8fb-7adc9a023e0a', 'a8ff9b3a-779b-4a28-af74-8f83982b29b4', 'c5e5c142-b97f-4a0d-aa80-f406f28f1e76', 'cf7312d6-7156-4022-9835-fe3815dab86c'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.125s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:14 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:57:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Deleted volume successfully. Sep 10 13:57:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-98ea5e34-58a7-43c0-b28c-fed14513804a tempest-CinderUnicodeTest-1541754757 None] Lock "cinder-385b04f1-5923-4eb4-9906-513b0dc61117-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:23 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=45,cinder:UPDATE=45,cinder:DELETE=6,cinder:INSERT=14 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:57:24 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=68,cinder:SELECT=27,cinder:DELETE=5,cinder:INSERT=10 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:57:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Flow 'volume_create_manager' (f05b7636-79b7-4692-9510-dc102e3da76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8253d77d-6a0e-4e22-a22b-8a2c271f45d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8253d77d-6a0e-4e22-a22b-8a2c271f45d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-936180981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f124316d-3fcf-457b-b91c-a8a57bb82fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98853ad66c343fc86ac8a761d024930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:47Z,use_quota=True,user_id='ed8d98d30d1946b3bc42004950351bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7ae528-d6aa-4051-b450-065f0ccbd7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7ae528-d6aa-4051-b450-065f0ccbd7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b2d2a9-2017-4e2a-b85e-757698060979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b2d2a9-2017-4e2a-b85e-757698060979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f124316d-3fcf-457b-b91c-a8a57bb82fbc', 'volume_name': 'volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1638d1b1-abbf-4037-9f3d-21f2d128a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1638d1b1-abbf-4037-9f3d-21f2d128a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40e1ef4-4df6-45da-a513-6b20c520d5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:47 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume f124316d-3fcf-457b-b91c-a8a57bb82fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc', 'volume_size': 1} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-936180981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f124316d-3fcf-457b-b91c-a8a57bb82fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98853ad66c343fc86ac8a761d024930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:47Z,use_quota=True,user_id='ed8d98d30d1946b3bc42004950351bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Creating volume f124316d-3fcf-457b-b91c-a8a57bb82fbc {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:57:47 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:47 devstack quobyte-client[83260]: System call of process 99621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:57:47 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=119, name=volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:57:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Flow 'volume_create_manager' (d12ea7b4-6089-44df-ba7d-94a53136baf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02584394-73ea-4a5b-b190-68aa66ff1c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02584394-73ea-4a5b-b190-68aa66ff1c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2087571905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1632b9ec-fa22-47f6-8924-ff102eb5b871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0218781d284c14ba65898689b7f363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:47Z,use_quota=True,user_id='3d5c17d6274c42cfa520c681b797d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc9d213-dcb0-44e2-9330-a8b693e01339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc9d213-dcb0-44e2-9330-a8b693e01339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b9fdf6-d52d-4ac7-8697-40e7a0523a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b9fdf6-d52d-4ac7-8697-40e7a0523a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1632b9ec-fa22-47f6-8924-ff102eb5b871', 'volume_name': 'volume-1632b9ec-fa22-47f6-8924-ff102eb5b871', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754ee4f7-d71a-449d-9695-fbc403e9f433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754ee4f7-d71a-449d-9695-fbc403e9f433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a748771-c60f-4222-b0b8-08dfe7b7834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:47 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Volume 1632b9ec-fa22-47f6-8924-ff102eb5b871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1632b9ec-fa22-47f6-8924-ff102eb5b871', 'volume_size': 1} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc 1073741824" returned: 0 in 0.565s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc" returned: 0 in 0.135s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] <== create_volume: return (739ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2087571905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1632b9ec-fa22-47f6-8924-ff102eb5b871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0218781d284c14ba65898689b7f363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:47Z,use_quota=True,user_id='3d5c17d6274c42cfa520c681b797d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Creating volume 1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:57:47 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:57:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:48 devstack quobyte-client[83260]: System call of process 99625 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:57:48 devstack quobyte-client[83260]: System call of process 99625 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:57:48 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=120, name=volume-1632b9ec-fa22-47f6-8924-ff102eb5b871, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40e1ef4-4df6-45da-a513-6b20c520d5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedcd17f-2ea3-494e-8064-0a13e7fec802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc (f124316d-3fcf-457b-b91c-a8a57bb82fbc): created successfully Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedcd17f-2ea3-494e-8064-0a13e7fec802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Flow 'volume_create_manager' (f05b7636-79b7-4692-9510-dc102e3da76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 1073741824" returned: 0 in 0.442s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871" returned: 0 in 0.140s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] <== create_volume: return (633ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:48 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-6189a6c0-d59a-492f-ad4d-b869562aa31b tempest-VolumeQuotasAdminTestJSON-711875887 None] Created volume successfully. Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a748771-c60f-4222-b0b8-08dfe7b7834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1632b9ec-fa22-47f6-8924-ff102eb5b871', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd803dea-b6f4-4b95-9c53-a74fd61abd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Volume volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 (1632b9ec-fa22-47f6-8924-ff102eb5b871): created successfully Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd803dea-b6f4-4b95-9c53-a74fd61abd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Flow 'volume_create_manager' (d12ea7b4-6089-44df-ba7d-94a53136baf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:48 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-15e46c8a-acf8-45f1-9105-851bdb0425ed tempest-SnapshotDependencyTests-1528919635 None] Created volume successfully. Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Acquiring lock "cinder-f124316d-3fcf-457b-b91c-a8a57bb82fbc-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "cinder-f124316d-3fcf-457b-b91c-a8a57bb82fbc-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Acquiring lock "cinder-quobyte-f124316d-3fcf-457b-b91c-a8a57bb82fbc" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "cinder-quobyte-f124316d-3fcf-457b-b91c-a8a57bb82fbc" acquired by "delete_volume" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c39449f-58b7-4d4e-9b52-4bfc20e38af0]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc" returned: 0 in 0.604s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Creating offline snapshot cedfec13-b04a-4516-bc58-5e8611ae44b7 of volume 1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-f124316d-3fcf-457b-b91c-a8a57bb82fbc" returned: 0 in 0.282s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ba398f-106d-4827-b165-b220d2b70889]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "cinder-quobyte-f124316d-3fcf-457b-b91c-a8a57bb82fbc" released by "delete_volume" :: held 1.084s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Created reservations ['4a672012-da2d-405b-b310-f23d84d14d0e', '6558c038-fdc4-425b-9c08-cff563843d54', '741c69e9-f4f1-4c89-a05b-8bc77c2e5f3c', '98d265c9-e6ec-4678-8c06-9c68e3213cc7'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871" returned: 0 in 0.631s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:51 devstack quobyte-client[83260]: System call of process 99638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:57:51 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=121, name=volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 1G" returned: 0 in 0.356s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:51 devstack quobyte-client[83260]: System call of process 99641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] CMD "qemu-img rebase -u -b volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7" returned: 0 in 0.420s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7" returned: 0 in 0.263s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.252s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:57:52 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Deleted volume successfully. Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7" returned: 0 in 0.451s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dcc6f33a-ed16-4157-80ff-a2972b06a849 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "cinder-f124316d-3fcf-457b-b91c-a8a57bb82fbc-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.info" returned: 0 in 0.355s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:57:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:53 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Flow 'volume_create_manager' (bbac405e-8caa-458a-82b8-0db0c4fcb1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842017c4-73e7-4fe8-a404-a8427f5672b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.info" returned: 0 in 0.468s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.466s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842017c4-73e7-4fe8-a404-a8427f5672b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1453699632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdbab78-c890-44da-a89c-239f34bc0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98853ad66c343fc86ac8a761d024930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:52Z,use_quota=True,user_id='ed8d98d30d1946b3bc42004950351bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf5a867-cf5a-4451-b6bb-f7f08fb3a80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf5a867-cf5a-4451-b6bb-f7f08fb3a80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb71ec9-3fbf-4d7f-ad42-c74cc2ec05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb71ec9-3fbf-4d7f-ad42-c74cc2ec05b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecdbab78-c890-44da-a89c-239f34bc0ca5', 'volume_name': 'volume-ecdbab78-c890-44da-a89c-239f34bc0ca5', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea42ff6-c920-4956-83e8-11f92b7412fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea42ff6-c920-4956-83e8-11f92b7412fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e14e9e-762f-4d58-8678-d9109a3d5470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:53 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume ecdbab78-c890-44da-a89c-239f34bc0ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecdbab78-c890-44da-a89c-239f34bc0ca5', 'volume_size': 1} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1453699632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdbab78-c890-44da-a89c-239f34bc0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98853ad66c343fc86ac8a761d024930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:52Z,use_quota=True,user_id='ed8d98d30d1946b3bc42004950351bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Creating volume ecdbab78-c890-44da-a89c-239f34bc0ca5 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:57:53 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:53 devstack quobyte-client[83260]: System call of process 99650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:57:53 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=123, name=volume-ecdbab78-c890-44da-a89c-239f34bc0ca5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:57:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8664c6d5-50d0-4232-a7b3-e59ff02a9c9e tempest-SnapshotDependencyTests-1528919635 None] Create snapshot completed successfully Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5 1073741824" returned: 0 in 0.452s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5" returned: 0 in 0.154s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] <== create_volume: return (643ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:57:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e14e9e-762f-4d58-8678-d9109a3d5470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecdbab78-c890-44da-a89c-239f34bc0ca5', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46171baf-14ad-451a-9bdd-3bf008eb0e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:54 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Volume volume-ecdbab78-c890-44da-a89c-239f34bc0ca5 (ecdbab78-c890-44da-a89c-239f34bc0ca5): created successfully Sep 10 13:57:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46171baf-14ad-451a-9bdd-3bf008eb0e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Flow 'volume_create_manager' (bbac405e-8caa-458a-82b8-0db0c4fcb1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:54 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4555bce8-0225-4494-baa1-bf63929399b1 tempest-VolumeQuotasAdminTestJSON-711875887 None] Created volume successfully. Sep 10 13:57:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Flow 'volume_create_manager' (ef074714-e11f-4966-a4ef-0678b7037dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4efd5be-b8b0-4e62-bdb5-039da23a6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4efd5be-b8b0-4e62-bdb5-039da23a6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8ddc61-40ea-4294-8cee-07d89e9f6a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0218781d284c14ba65898689b7f363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cedfec13-b04a-4516-bc58-5e8611ae44b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:56Z,use_quota=True,user_id='3d5c17d6274c42cfa520c681b797d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccc1455-c95c-4d57-a9c4-8a8ba1826208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccc1455-c95c-4d57-a9c4-8a8ba1826208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c310355d-9aa3-4639-85dd-9e958ad3a40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c310355d-9aa3-4639-85dd-9e958ad3a40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad8ddc61-40ea-4294-8cee-07d89e9f6a3b', 'volume_name': 'volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b', 'volume_size': 1, 'snapshot_id': 'cedfec13-b04a-4516-bc58-5e8611ae44b7'}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bfe3a1e-1669-4ed0-9c4b-b11c36696f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bfe3a1e-1669-4ed0-9c4b-b11c36696f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241e734e-56f2-4420-90a3-791baa3d2b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:57:55 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Volume ad8ddc61-40ea-4294-8cee-07d89e9f6a3b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b', 'volume_size': 1, 'snapshot_id': 'cedfec13-b04a-4516-bc58-5e8611ae44b7'} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-quobyte-cedfec13-b04a-4516-bc58-5e8611ae44b7-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" by "_create_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-cedfec13-b04a-4516-bc58-5e8611ae44b7-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Creating volume ad8ddc61-40ea-4294-8cee-07d89e9f6a3b from snapshot cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-quobyte-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" by "_copy_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] snapshot: cedfec13-b04a-4516-bc58-5e8611ae44b7, volume: ad8ddc61-40ea-4294-8cee-07d89e9f6a3b, {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ff9128-04c1-4083-8c3e-0689c85ed170]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7" returned: 0 in 0.480s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1632b9ec-fa22-47f6-8924-ff102eb5b871(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Creating direct copy from snapshot {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d06bb2c-6e65-4215-8e08-217ca39d02d7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:56 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2de0e16b-f88a-4f2b-bf0c-5c823b86e3ae tempest-VolumeQuotasAdminTestJSON-686665741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:57 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2de0e16b-f88a-4f2b-bf0c-5c823b86e3ae tempest-VolumeQuotasAdminTestJSON-686665741 None] Transfer volume completed successfully. Sep 10 13:57:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871" returned: 0 in 0.586s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:57:57 devstack cinder-volume[83206]: DEBUG cinder.utils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b not found in is_blk_device check {{(pid=83206) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 13:57:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:57:57 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=124, name=volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:57:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Acquiring lock "cinder-ecdbab78-c890-44da-a89c-239f34bc0ca5-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Lock "cinder-ecdbab78-c890-44da-a89c-239f34bc0ca5-delete_volume" acquired by "delete_volume" :: waited 0.288s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:57:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Acquiring lock "cinder-quobyte-ecdbab78-c890-44da-a89c-239f34bc0ca5" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:57:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Lock "cinder-quobyte-ecdbab78-c890-44da-a89c-239f34bc0ca5" acquired by "delete_volume" :: waited 0.044s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:57:59 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f865e6b3-f739-4979-b618-6101600fbee1]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:57:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:01 devstack quobyte-client[83260]: System call of process 99670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:58:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5" returned: 0 in 1.410s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ecdbab78-c890-44da-a89c-239f34bc0ca5" returned: 0 in 0.294s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Lock "cinder-quobyte-ecdbab78-c890-44da-a89c-239f34bc0ca5" released by "delete_volume" :: held 2.412s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:02 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Created reservations ['a14e13c1-6ca6-43bd-bca5-d07400f8922e', '08591f1f-7576-4507-aa25-a382bffdb75e', 'c09518f2-30ff-4310-8660-6125452a3d0a', '5e264596-25fd-43e7-8f3d-710a602101b2'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.460s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:03 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:58:04 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Deleted volume successfully. Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" returned: 0 in 7.686s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256879f-36f0-4f0d-afe1-9bac2769c3b6]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0fcb5b93-f7bd-4411-a5e2-9ebee04a6b16 tempest-VolumeQuotasAdminTestJSON-1875075540 None] Lock "cinder-ecdbab78-c890-44da-a89c-239f34bc0ca5-delete_volume" released by "delete_volume" :: held 6.088s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871" returned: 0 in 0.758s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Image conversion details: src /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:58:05 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Converted 1024.00 MB image at 133.15 MB/s Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:58:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" returned: 0 in 0.183s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" released by "_copy_volume_from_snapshot" :: held 10.099s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-cedfec13-b04a-4516-bc58-5e8611ae44b7-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" released by "_create_volume_from_snapshot" :: held 10.155s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.180s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241e734e-56f2-4420-90a3-791baa3d2b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b', 'volume_size': 1, 'snapshot_id': 'cedfec13-b04a-4516-bc58-5e8611ae44b7'}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a26af0c-b60a-4ae3-9b47-a08503ca0cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Volume volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b (ad8ddc61-40ea-4294-8cee-07d89e9f6a3b): created successfully Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a26af0c-b60a-4ae3-9b47-a08503ca0cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Flow 'volume_create_manager' (ef074714-e11f-4966-a4ef-0678b7037dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:58:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-062bbfe9-600d-4185-8f31-cd10637c00a0 tempest-SnapshotDependencyTests-1528919635 None] Created volume successfully. Sep 10 13:58:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-cedfec13-b04a-4516-bc58-5e8611ae44b7-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-cedfec13-b04a-4516-bc58-5e8611ae44b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:07 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-quobyte-1632b9ec-fa22-47f6-8924-ff102eb5b871" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-1632b9ec-fa22-47f6-8924-ff102eb5b871" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-quobyte-cedfec13-b04a-4516-bc58-5e8611ae44b7" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:07 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-cedfec13-b04a-4516-bc58-5e8611ae44b7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Deleting offline snapshot cedfec13-b04a-4516-bc58-5e8611ae44b7 of volume 1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:58:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] snapshot_file for this snap is: volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:58:08 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3773827-9d7b-4d22-9cd7-5c73f78b3e91]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7" returned: 0 in 0.464s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1632b9ec-fa22-47f6-8924-ff102eb5b871(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:58:08 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cda39b-c6af-4040-81e9-3d08562c2400]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871" returned: 0 in 0.491s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7" returned: 0 in 0.252s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871.cedfec13-b04a-4516-bc58-5e8611ae44b7" returned: 0 in 0.104s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-cedfec13-b04a-4516-bc58-5e8611ae44b7" released by "_delete_snapshot" :: held 1.724s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-1632b9ec-fa22-47f6-8924-ff102eb5b871" released by "delete_snapshot" :: held 1.756s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:10 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Created reservations ['2bafd2ff-7a8f-48f5-be0d-b1e76a5f46f6', '6d6b052d-eb11-401d-a196-e97321b72db0', '3fd8f8da-67c6-4733-a507-96ef834d50da', 'ee80d592-90d0-436c-9e31-d557cefca1a5'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:58:10 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Delete snapshot completed successfully. Sep 10 13:58:10 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7b04e539-6f96-47c4-9382-adf90372bd67 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-cedfec13-b04a-4516-bc58-5e8611ae44b7-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-1632b9ec-fa22-47f6-8924-ff102eb5b871-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-1632b9ec-fa22-47f6-8924-ff102eb5b871-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:12 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-quobyte-1632b9ec-fa22-47f6-8924-ff102eb5b871" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.604s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-1632b9ec-fa22-47f6-8924-ff102eb5b871" acquired by "delete_volume" :: waited 0.095s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8800e415-5e2e-4a5e-acdb-b02f617254ab]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871" returned: 0 in 0.469s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1632b9ec-fa22-47f6-8924-ff102eb5b871" returned: 0 in 0.099s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-1632b9ec-fa22-47f6-8924-ff102eb5b871" released by "delete_volume" :: held 0.789s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Created reservations ['e12293b5-5e0f-47cb-a2f2-8f71e0bfe795', 'fd86e4af-24c7-4b87-b215-3edf5b956817', '4e47bc41-3968-4787-9610-aa8af38e342d', '487a99a2-a0e0-4994-b5b1-24bdab3802e4'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.117s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:13 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:58:13 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Deleted volume successfully. Sep 10 13:58:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-74c16194-e451-4a0e-a2a2-ecd6f9f607e3 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-1632b9ec-fa22-47f6-8924-ff102eb5b871-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "cinder-quobyte-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" acquired by "delete_volume" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b63d99-6890-4dec-8235-392f9009eee3]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" returned: 0 in 0.491s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" returned: 0 in 0.121s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-quobyte-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b" released by "delete_volume" :: held 0.828s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Created reservations ['8e10237f-5163-49e7-abc2-7d6065467f1f', 'bef6f9cb-b919-4b98-8a26-f1189e09df97', '2a237c6e-198d-4dae-a821-5185b2279510', 'cf30f273-9cdb-40c2-9da0-a4c2127fc6ec'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.146s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:16 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:58:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Deleted volume successfully. Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-daa704ea-c088-4444-8bb7-105bfbf79887 tempest-SnapshotDependencyTests-1528919635 None] Lock "cinder-ad8ddc61-40ea-4294-8cee-07d89e9f6a3b-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:17 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Flow 'volume_create_manager' (c46a1e08-1d57-4971-b1f9-9a62faa0f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8af0eb-da89-4716-bc3b-eb75eae79c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8af0eb-da89-4716-bc3b-eb75eae79c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2042592601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7fab7c-c7cc-451f-92bb-4282e81dc968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70879e7d0d0142968f752ecdcf4d00d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:17Z,use_quota=True,user_id='310d562d1bc94278996807bba7cc2675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff8003e-1aa7-4dd1-a5ce-8ddc7eab285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff8003e-1aa7-4dd1-a5ce-8ddc7eab285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f1c7d-c754-4eb2-b7c4-9077b14a6c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f1c7d-c754-4eb2-b7c4-9077b14a6c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7fab7c-c7cc-451f-92bb-4282e81dc968', 'volume_name': 'volume-db7fab7c-c7cc-451f-92bb-4282e81dc968', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35986f53-bc45-4b8a-a719-7a22803d39ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35986f53-bc45-4b8a-a719-7a22803d39ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b69da8-1acf-4eec-86e7-200645a43f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:17 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Volume db7fab7c-c7cc-451f-92bb-4282e81dc968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7fab7c-c7cc-451f-92bb-4282e81dc968', 'volume_size': 1} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2042592601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7fab7c-c7cc-451f-92bb-4282e81dc968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70879e7d0d0142968f752ecdcf4d00d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:17Z,use_quota=True,user_id='310d562d1bc94278996807bba7cc2675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Creating volume db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:58:17 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:58:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:17 devstack quobyte-client[83260]: System call of process 99736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:58:17 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=125, name=volume-db7fab7c-c7cc-451f-92bb-4282e81dc968, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 1073741824" returned: 0 in 0.467s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968" returned: 0 in 0.132s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b69da8-1acf-4eec-86e7-200645a43f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7fab7c-c7cc-451f-92bb-4282e81dc968', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a97ff0-abcf-4ecc-8444-3400ad86d0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:18 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Volume volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 (db7fab7c-c7cc-451f-92bb-4282e81dc968): created successfully Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a97ff0-abcf-4ecc-8444-3400ad86d0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:18 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Flow 'volume_create_manager' (c46a1e08-1d57-4971-b1f9-9a62faa0f352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:58:18 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d36aadd8-34f0-4e39-b67c-aafcce47dbd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Created volume successfully. Sep 10 13:58:19 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Creating offline snapshot 6e497660-181d-4068-9ebe-b87e0f6a18b1 of volume db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:58:19 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5676eca0-34b4-4765-8541-77e268581975]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:20 devstack quobyte-client[83260]: System call of process 99747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:58:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968" returned: 0 in 0.730s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:20 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=126, name=volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 1G" returned: 0 in 0.294s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): qemu-img rebase -u -b volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "qemu-img rebase -u -b volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1" returned: 0 in 0.169s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1" returned: 0 in 0.116s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1" returned: 0 in 0.110s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.info" returned: 0 in 0.113s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.info" returned: 0 in 0.114s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:22 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-60858ae6-86e0-4f87-bc0e-d874b5383088 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Create snapshot completed successfully Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "cinder-6e497660-181d-4068-9ebe-b87e0f6a18b1-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-6e497660-181d-4068-9ebe-b87e0f6a18b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:24 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "cinder-quobyte-db7fab7c-c7cc-451f-92bb-4282e81dc968" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-quobyte-db7fab7c-c7cc-451f-92bb-4282e81dc968" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "cinder-quobyte-6e497660-181d-4068-9ebe-b87e0f6a18b1" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-quobyte-6e497660-181d-4068-9ebe-b87e0f6a18b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Deleting offline snapshot 6e497660-181d-4068-9ebe-b87e0f6a18b1 of volume db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] snapshot_file for this snap is: volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb09ea-72b9-41ab-94de-e9c4193f8495]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1" returned: 0 in 0.480s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7fab7c-c7cc-451f-92bb-4282e81dc968(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce858a61-d3e1-4576-8b87-9550667a770c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968" returned: 0 in 0.615s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1" returned: 0 in 0.267s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968.6e497660-181d-4068-9ebe-b87e0f6a18b1" returned: 0 in 0.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-quobyte-6e497660-181d-4068-9ebe-b87e0f6a18b1" released by "_delete_snapshot" :: held 1.837s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-quobyte-db7fab7c-c7cc-451f-92bb-4282e81dc968" released by "delete_snapshot" :: held 1.868s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:26 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Created reservations ['95ee7c92-b988-4968-8c45-acba20ddf175', 'ee0c95fd-20f8-4808-8154-c9395aa31295', 'ea465a57-f537-4c62-bc0d-e7778dcd2d8d', '7e0c8de6-bbc8-47af-915c-a14b758012d7'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:58:26 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Delete snapshot completed successfully. Sep 10 13:58:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-d1388ac0-6c1b-413b-9140-5c890865ad83 tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-6e497660-181d-4068-9ebe-b87e0f6a18b1-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "cinder-db7fab7c-c7cc-451f-92bb-4282e81dc968-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-db7fab7c-c7cc-451f-92bb-4282e81dc968-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "cinder-quobyte-db7fab7c-c7cc-451f-92bb-4282e81dc968" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-quobyte-db7fab7c-c7cc-451f-92bb-4282e81dc968" acquired by "delete_volume" :: waited 0.028s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:27 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2f874-1731-427b-9045-b8df9b38822b]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968" returned: 0 in 0.666s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-db7fab7c-c7cc-451f-92bb-4282e81dc968" returned: 0 in 0.111s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-quobyte-db7fab7c-c7cc-451f-92bb-4282e81dc968" released by "delete_volume" :: held 0.996s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:28 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Created reservations ['2fefda08-4d15-413a-bcd0-6888eda8bf70', '7a61c509-c3fd-48e5-be66-ebf22a7a417b', '34417af3-f4ad-4576-b138-b85a1ad9243d', 'd793e400-6031-4b60-b650-a552935b33ae'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.151s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:58:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Deleted volume successfully. Sep 10 13:58:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-0bd899ad-1171-4400-a048-c29024470cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-2109320199 None] Lock "cinder-db7fab7c-c7cc-451f-92bb-4282e81dc968-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:39 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=64,cinder:SELECT=48,cinder:DELETE=4,cinder:INSERT=17 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:58:39 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=41,cinder:UPDATE=63,cinder:DELETE=8,cinder:INSERT=11 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:58:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Flow 'volume_create_manager' (174316b0-e691-4d49-bc3e-8b2ca8366d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950d61b9-f5c8-4131-913e-a588abe6f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950d61b9-f5c8-4131-913e-a588abe6f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-861254308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb05c8d-d1c0-4d0e-8bcd-0af217107030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff29a96efad40729bec41faa04e85e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:49Z,use_quota=True,user_id='40cb3a8f15184cd393ad8b0aa0c68631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3bc0e-fa4f-4a3d-8d5a-87126587f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3bc0e-fa4f-4a3d-8d5a-87126587f27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f459a5-9057-495d-a43d-b7ae9f83f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f459a5-9057-495d-a43d-b7ae9f83f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb05c8d-d1c0-4d0e-8bcd-0af217107030', 'volume_name': 'volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba3adbb-5923-475b-bf62-5c57f8669247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba3adbb-5923-475b-bf62-5c57f8669247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a555f11a-d84e-4faa-b579-33481b47d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:49 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Volume 1fb05c8d-d1c0-4d0e-8bcd-0af217107030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030', 'volume_size': 1} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-861254308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb05c8d-d1c0-4d0e-8bcd-0af217107030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff29a96efad40729bec41faa04e85e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:49Z,use_quota=True,user_id='40cb3a8f15184cd393ad8b0aa0c68631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Creating volume 1fb05c8d-d1c0-4d0e-8bcd-0af217107030 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:58:49 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:49 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=128, name=volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030 1073741824" returned: 0 in 0.383s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030" returned: 0 in 0.082s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] <== create_volume: return (527ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:58:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.537s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a555f11a-d84e-4faa-b579-33481b47d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ff5d43-f375-4b7e-87e8-d3aa2ca510ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:50 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Volume volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030 (1fb05c8d-d1c0-4d0e-8bcd-0af217107030): created successfully Sep 10 13:58:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ff5d43-f375-4b7e-87e8-d3aa2ca510ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Flow 'volume_create_manager' (174316b0-e691-4d49-bc3e-8b2ca8366d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:58:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1263ccc7-34ca-4a33-a3e0-a8dee0a62fa8 tempest-AbsoluteLimitsTests-975191950 None] Created volume successfully. Sep 10 13:58:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Acquiring lock "cinder-1fb05c8d-d1c0-4d0e-8bcd-0af217107030-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Lock "cinder-1fb05c8d-d1c0-4d0e-8bcd-0af217107030-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:51 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Acquiring lock "cinder-quobyte-1fb05c8d-d1c0-4d0e-8bcd-0af217107030" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:58:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Lock "cinder-quobyte-1fb05c8d-d1c0-4d0e-8bcd-0af217107030" acquired by "delete_volume" :: waited 0.017s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:58:51 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b0a98b-40a3-457e-aa1b-71083ac968ab]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030" returned: 0 in 0.401s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1fb05c8d-d1c0-4d0e-8bcd-0af217107030" returned: 0 in 0.081s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Lock "cinder-quobyte-1fb05c8d-d1c0-4d0e-8bcd-0af217107030" released by "delete_volume" :: held 0.633s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Created reservations ['483dae57-8fbe-476b-84dd-a5c8117fad3e', 'e0edd62b-fee6-47f0-9221-805dec53b0b8', 'b4a8eeaa-b9be-43ec-bfbe-3e1fb91e2805', '7f9a4b26-0bb6-4ef0-a348-ae154c29b46b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.092s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:58:52 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:58:52 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Deleted volume successfully. Sep 10 13:58:53 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-262b1e9d-67df-4f43-861a-f886d7d4200e tempest-AbsoluteLimitsTests-975191950 None] Lock "cinder-1fb05c8d-d1c0-4d0e-8bcd-0af217107030-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:58:58 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:58:58 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Flow 'volume_create_manager' (3dc1a1b4-312b-48a7-97ae-6bcdb612145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79f9d36-456c-4cb6-83e5-f28947430576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79f9d36-456c-4cb6-83e5-f28947430576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1781046298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9341f9b5-06e0-4bc0-8076-04121540f65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26326995bdc0431e8b673f6e6cbad3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:59Z,use_quota=True,user_id='8b8bce8ce9d8447ba54cfd97fa8a1ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee2d7f2-b150-495a-9e07-f4b05d4ea0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee2d7f2-b150-495a-9e07-f4b05d4ea0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b173f66-e9fa-43fa-9377-04ee9bba3f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b173f66-e9fa-43fa-9377-04ee9bba3f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9341f9b5-06e0-4bc0-8076-04121540f65a', 'volume_name': 'volume-9341f9b5-06e0-4bc0-8076-04121540f65a', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec18403-87f8-45e8-97c6-c4fb7a6e88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec18403-87f8-45e8-97c6-c4fb7a6e88de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4d0daa-17ea-46ad-aaec-e5e9e3791939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:58:59 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Volume 9341f9b5-06e0-4bc0-8076-04121540f65a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9341f9b5-06e0-4bc0-8076-04121540f65a', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Cloning 9341f9b5-06e0-4bc0-8076-04121540f65a from image 63abeada-c2a5-416e-b79d-1e59204999db at location (None, None). {{(pid=83206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 13:58:59 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Image download 20.69 MB at 20.69 MB/s Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7cf892-cea6-4d26-b32a-94ce9efd3edf]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:58:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:00 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD Sep 10 13:59:00 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:59:01 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 10 13:59:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD" returned: 0 in 2.015s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:01 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db is fetched for user 8b8bce8ce9d8447ba54cfd97fa8a1ed9. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 13:59:02 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eea6643-2293-4d08-bf41-1ed0d40285f2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:02 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD Sep 10 13:59:02 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 13:59:03 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD" returned: 0 in 1.925s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1781046298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9341f9b5-06e0-4bc0-8076-04121540f65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26326995bdc0431e8b673f6e6cbad3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:59Z,use_quota=True,user_id='8b8bce8ce9d8447ba54cfd97fa8a1ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Creating volume 9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:59:04 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:04 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=129, name=volume-9341f9b5-06e0-4bc0-8076-04121540f65a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a 1073741824" returned: 0 in 0.363s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 0 in 0.086s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] <== create_volume: return (534ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.564s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Attempting download of 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume 9341f9b5-06e0-4bc0-8076-04121540f65a. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8967680d-2d22-48ab-84f1-40b4a7bfc0d2]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_bpe0vgb7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_bpe0vgb7" returned: 0 in 0.348s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_bpe0vgb7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_bpe0vgb7" returned: 1 in 0.350s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63abeada-c2a5-416e-b79d-1e59204999db_bpe0vgb7' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:59:05 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38d84d7-fdd4-402c-9d95-db049b83c482]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:06 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] 63abeada-c2a5-416e-b79d-1e59204999db was qcow2, converting to raw {{(pid=83206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 13:59:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:06 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=129, name=volume-9341f9b5-06e0-4bc0-8076-04121540f65a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 0 in 1.005s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63abeada-c2a5-416e-b79d-1e59204999db_tgr3ang9devstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 13:59:07 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Converted 112.00 MB image at 108.54 MB/s Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a 1G" returned: 0 in 0.135s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c40f69c-1469-4365-b68d-fe1456e5408f]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 0 in 0.398s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 1 in 0.343s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Downloaded image 63abeada-c2a5-416e-b79d-1e59204999db ((None, None)) to volume 9341f9b5-06e0-4bc0-8076-04121540f65a successfully. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Temporary image 63abeada-c2a5-416e-b79d-1e59204999db for user 8b8bce8ce9d8447ba54cfd97fa8a1ed9 is deleted. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Marking volume 9341f9b5-06e0-4bc0-8076-04121540f65a as bootable. {{(pid=83206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Copying metadata from image 63abeada-c2a5-416e-b79d-1e59204999db to 9341f9b5-06e0-4bc0-8076-04121540f65a. {{(pid=83206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Creating volume glance metadata for volume 9341f9b5-06e0-4bc0-8076-04121540f65a backed by image 63abeada-c2a5-416e-b79d-1e59204999db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4d0daa-17ea-46ad-aaec-e5e9e3791939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9341f9b5-06e0-4bc0-8076-04121540f65a', 'volume_size': 1, 'image_id': '63abeada-c2a5-416e-b79d-1e59204999db', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59d3b5b3749d4c4288755a44e03eb15d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '63abeada-c2a5-416e-b79d-1e59204999db', 'created_at': datetime.datetime(2025, 9, 10, 11, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 9, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63abeada-c2a5-416e-b79d-1e59204999db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1f5642-575f-4ece-9148-8e73fbabc3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:08 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Volume volume-9341f9b5-06e0-4bc0-8076-04121540f65a (9341f9b5-06e0-4bc0-8076-04121540f65a): created successfully Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1f5642-575f-4ece-9148-8e73fbabc3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Flow 'volume_create_manager' (3dc1a1b4-312b-48a7-97ae-6bcdb612145a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:08 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-632dbba0-92ef-4695-bdb7-c7d49ace46b0 tempest-VolumesExtendTest-1721860063 None] Created volume successfully. Sep 10 13:59:09 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:09 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1387482-ba0a-44b8-86a8-0522b2b6b047]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 0 in 0.364s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 1 in 0.360s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:59:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a 2G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a 2G" returned: 0 in 0.133s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.040s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:11 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-91745319-2644-4f1d-82fd-c14f712fde11 tempest-VolumesExtendTest-1721860063 None] Extend volume completed successfully. Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:59:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "cinder-9341f9b5-06e0-4bc0-8076-04121540f65a-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-9341f9b5-06e0-4bc0-8076-04121540f65a-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:12 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "cinder-quobyte-9341f9b5-06e0-4bc0-8076-04121540f65a" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-9341f9b5-06e0-4bc0-8076-04121540f65a" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:12 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18599d91-7aef-491e-8c78-cb81f3330c06]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 0 in 0.457s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 1 in 0.385s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 13:59:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-9341f9b5-06e0-4bc0-8076-04121540f65a" returned: 0 in 0.086s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-9341f9b5-06e0-4bc0-8076-04121540f65a" released by "delete_volume" :: held 1.212s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Created reservations ['bfd7fe82-ea9b-4cc2-9fce-2cdac0d00f3e', 'a0a4c577-7c4e-4afd-9b5d-b9d8bae0ec06', '58c27069-cd25-43f3-8105-312acf83c871', 'd02c48ce-aec5-44a1-8fb3-4a081b90d648'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:59:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Deleted volume successfully. Sep 10 13:59:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-44e0594e-2629-44c6-a016-957dd989e129 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-9341f9b5-06e0-4bc0-8076-04121540f65a-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:15 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Flow 'volume_create_manager' (739c60b0-d2c2-497f-a508-31a8588eee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f72da3-af3c-48a3-b177-97e2674714c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f72da3-af3c-48a3-b177-97e2674714c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-582140233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00f8b7b-259d-400a-a63f-17b639d54804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26326995bdc0431e8b673f6e6cbad3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:15Z,use_quota=True,user_id='8b8bce8ce9d8447ba54cfd97fa8a1ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a02abf6-305e-4bff-af7e-84bf216924ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a02abf6-305e-4bff-af7e-84bf216924ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc29ce8-0fbb-4710-8563-a92a3cf33f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc29ce8-0fbb-4710-8563-a92a3cf33f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00f8b7b-259d-400a-a63f-17b639d54804', 'volume_name': 'volume-b00f8b7b-259d-400a-a63f-17b639d54804', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28277185-8c51-4fbe-87cd-e94e24284c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28277185-8c51-4fbe-87cd-e94e24284c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3055a8a-999e-487b-a342-de60952cdde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:15 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Volume b00f8b7b-259d-400a-a63f-17b639d54804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00f8b7b-259d-400a-a63f-17b639d54804', 'volume_size': 1} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-582140233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00f8b7b-259d-400a-a63f-17b639d54804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26326995bdc0431e8b673f6e6cbad3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:15Z,use_quota=True,user_id='8b8bce8ce9d8447ba54cfd97fa8a1ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Creating volume b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:59:15 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:59:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:15 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=130, name=volume-b00f8b7b-259d-400a-a63f-17b639d54804, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 1073741824" returned: 0 in 0.330s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804" returned: 0 in 0.212s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] <== create_volume: return (598ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.608s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3055a8a-999e-487b-a342-de60952cdde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00f8b7b-259d-400a-a63f-17b639d54804', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5404ee-e2a9-4221-9582-878034cec0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:16 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Volume volume-b00f8b7b-259d-400a-a63f-17b639d54804 (b00f8b7b-259d-400a-a63f-17b639d54804): created successfully Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5404ee-e2a9-4221-9582-878034cec0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Flow 'volume_create_manager' (739c60b0-d2c2-497f-a508-31a8588eee20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-584495b6-7c17-4fe8-9560-31776377c99c tempest-VolumesExtendTest-1721860063 None] Created volume successfully. Sep 10 13:59:17 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:18 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Creating offline snapshot a07af6c6-acc8-4b36-9b0a-298dfa290bf5 of volume b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:59:18 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd6328-7544-46c8-8377-203e8e8e17ba]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804" returned: 0 in 0.438s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:18 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=131, name=volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 1G" returned: 0 in 0.309s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b00f8b7b-259d-400a-a63f-17b639d54804 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img rebase -u -b volume-b00f8b7b-259d-400a-a63f-17b639d54804 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5" returned: 0 in 0.161s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5" returned: 0 in 0.137s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5" returned: 0 in 0.092s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.info" returned: 0 in 0.133s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.info" returned: 0 in 0.146s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:20 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f0254cac-e7c8-498d-be83-0f0717ac92ee tempest-VolumesExtendTest-1721860063 None] Create snapshot completed successfully Sep 10 13:59:21 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:21 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[505f3473-dfe5-44e4-b76a-658da2617a77]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804" returned: 0 in 0.466s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 2G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:21 devstack quobyte-client[83260]: System call of process 99907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:59:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 2G" returned: 0 in 0.244s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.820s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:22 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1faaa59e-7685-421f-a64d-d5c227039214 tempest-VolumesExtendTest-1721860063 None] Extend volume completed successfully. Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "cinder-a07af6c6-acc8-4b36-9b0a-298dfa290bf5-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-a07af6c6-acc8-4b36-9b0a-298dfa290bf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.109s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:23 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "cinder-quobyte-b00f8b7b-259d-400a-a63f-17b639d54804" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-b00f8b7b-259d-400a-a63f-17b639d54804" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "cinder-quobyte-a07af6c6-acc8-4b36-9b0a-298dfa290bf5" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-a07af6c6-acc8-4b36-9b0a-298dfa290bf5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Deleting offline snapshot a07af6c6-acc8-4b36-9b0a-298dfa290bf5 of volume b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] snapshot_file for this snap is: volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[690330db-585a-4eb7-8ae8-ad29a2a9d4b2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5" returned: 0 in 0.403s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b00f8b7b-259d-400a-a63f-17b639d54804(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 13:59:24 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9f39d4-66c1-458d-85d8-84d12384d449]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804" returned: 0 in 0.465s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5" returned: 0 in 0.281s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804.a07af6c6-acc8-4b36-9b0a-298dfa290bf5" returned: 0 in 0.128s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-a07af6c6-acc8-4b36-9b0a-298dfa290bf5" released by "_delete_snapshot" :: held 1.552s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-b00f8b7b-259d-400a-a63f-17b639d54804" released by "delete_snapshot" :: held 1.575s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:25 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Created reservations ['272612f5-d0b0-4681-aee2-c31516469cad', '0c7bcc33-968b-4a4e-b331-83f818d50b85', '80124142-0e9d-4399-99f7-d3065fc27726', '28a7ba9f-6a54-412f-88a4-fb98fd6b4f92'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:59:25 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Delete snapshot completed successfully. Sep 10 13:59:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f2523381-f6f5-4415-b4a0-b8ee409aa332 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-a07af6c6-acc8-4b36-9b0a-298dfa290bf5-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "cinder-b00f8b7b-259d-400a-a63f-17b639d54804-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-b00f8b7b-259d-400a-a63f-17b639d54804-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:26 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "cinder-quobyte-b00f8b7b-259d-400a-a63f-17b639d54804" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-b00f8b7b-259d-400a-a63f-17b639d54804" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f2f5d-e95f-4acb-98e5-e2c485adb94f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804" returned: 0 in 0.429s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b00f8b7b-259d-400a-a63f-17b639d54804" returned: 0 in 0.134s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-quobyte-b00f8b7b-259d-400a-a63f-17b639d54804" released by "delete_volume" :: held 0.736s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Created reservations ['2bdbc811-3953-4ca4-8259-8f181df7c2a5', '7e018390-e864-4eac-9170-61547b8a84de', '3b7250b4-d088-45ee-a413-dd3b3925e5ab', '4ddb8b33-b47f-4920-ac36-e122a1d56caa'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:59:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Deleted volume successfully. Sep 10 13:59:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-e007e185-77b0-4fa5-8aa9-f329a9fb2f21 tempest-VolumesExtendTest-1721860063 None] Lock "cinder-b00f8b7b-259d-400a-a63f-17b639d54804-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:32 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Flow 'volume_create_manager' (07cdeb2b-41aa-4f3f-9c23-3c85ab4b7aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec2053-fbdc-4b94-b65d-196f12f1e42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec2053-fbdc-4b94-b65d-196f12f1e42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-363011345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fed482-f9bc-45f7-91d6-543929463823,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9112c477f6974af08d64a11095807cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:32Z,use_quota=True,user_id='63821ced21e54c8ea28c36c447e78911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58151a9-9844-448b-a325-63049797dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58151a9-9844-448b-a325-63049797dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64984a5-4da6-43ea-ad22-9bfb1953612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64984a5-4da6-43ea-ad22-9bfb1953612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fed482-f9bc-45f7-91d6-543929463823', 'volume_name': 'volume-84fed482-f9bc-45f7-91d6-543929463823', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff41cc85-9cf8-48da-82ac-ff248f9537ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff41cc85-9cf8-48da-82ac-ff248f9537ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118ba8e7-a5a1-406b-a020-85cbfc0cd7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:32 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Volume 84fed482-f9bc-45f7-91d6-543929463823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fed482-f9bc-45f7-91d6-543929463823', 'volume_size': 1} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-363011345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fed482-f9bc-45f7-91d6-543929463823,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9112c477f6974af08d64a11095807cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:32Z,use_quota=True,user_id='63821ced21e54c8ea28c36c447e78911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Creating volume 84fed482-f9bc-45f7-91d6-543929463823 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:59:32 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:32 devstack quobyte-client[83260]: System call of process 99927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:59:32 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=133, name=volume-84fed482-f9bc-45f7-91d6-543929463823, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823 1073741824" returned: 0 in 0.390s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823" returned: 0 in 0.102s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:59:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.574s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118ba8e7-a5a1-406b-a020-85cbfc0cd7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fed482-f9bc-45f7-91d6-543929463823', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c200a7-b463-4156-bd87-6a4962cafb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:33 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Volume volume-84fed482-f9bc-45f7-91d6-543929463823 (84fed482-f9bc-45f7-91d6-543929463823): created successfully Sep 10 13:59:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c200a7-b463-4156-bd87-6a4962cafb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:33 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Flow 'volume_create_manager' (07cdeb2b-41aa-4f3f-9c23-3c85ab4b7aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:33 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4781dd32-2f21-450e-8f49-e64d6da24117 tempest-VolumesListTestJSON-173598036 None] Created volume successfully. Sep 10 13:59:34 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Flow 'volume_create_manager' (b5872b2f-2761-429d-99e2-2b002acfc5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31b46cd-8ec8-439b-80bd-10a8d944ebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31b46cd-8ec8-439b-80bd-10a8d944ebe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-875730973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6434e8b7-cd6e-4829-88f0-3508617225af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9112c477f6974af08d64a11095807cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:35Z,use_quota=True,user_id='63821ced21e54c8ea28c36c447e78911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7dd2fe-074d-4a0a-a91c-e0248fbc97fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7dd2fe-074d-4a0a-a91c-e0248fbc97fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f336f899-436c-4613-9a4c-cd26c6f5fa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f336f899-436c-4613-9a4c-cd26c6f5fa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6434e8b7-cd6e-4829-88f0-3508617225af', 'volume_name': 'volume-6434e8b7-cd6e-4829-88f0-3508617225af', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937b9d27-3c5a-484c-8571-91cfa278bda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937b9d27-3c5a-484c-8571-91cfa278bda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbad772-49e9-47b1-8f5d-115d8e479502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:34 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Volume 6434e8b7-cd6e-4829-88f0-3508617225af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6434e8b7-cd6e-4829-88f0-3508617225af', 'volume_size': 1} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-875730973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6434e8b7-cd6e-4829-88f0-3508617225af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9112c477f6974af08d64a11095807cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:35Z,use_quota=True,user_id='63821ced21e54c8ea28c36c447e78911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Creating volume 6434e8b7-cd6e-4829-88f0-3508617225af {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:59:34 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:59:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:35 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=134, name=volume-6434e8b7-cd6e-4829-88f0-3508617225af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af 1073741824" returned: 0 in 0.352s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af" returned: 0 in 0.089s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] <== create_volume: return (515ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbad772-49e9-47b1-8f5d-115d8e479502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6434e8b7-cd6e-4829-88f0-3508617225af', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869dcffd-38d6-4db3-ae5d-80f3a89286e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:35 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Volume volume-6434e8b7-cd6e-4829-88f0-3508617225af (6434e8b7-cd6e-4829-88f0-3508617225af): created successfully Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869dcffd-38d6-4db3-ae5d-80f3a89286e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:35 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Flow 'volume_create_manager' (b5872b2f-2761-429d-99e2-2b002acfc5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:35 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-03f89931-528c-4834-a851-c2831a7ae893 tempest-VolumesListTestJSON-173598036 None] Created volume successfully. Sep 10 13:59:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Flow 'volume_create_manager' (e7140bd3-6f85-4882-9f42-1a50990b2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba65877b-ffd1-47fc-9ade-d997743e3e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba65877b-ffd1-47fc-9ade-d997743e3e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-692247467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b9d635-9224-49de-9848-ae3d8fb2a05a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9112c477f6974af08d64a11095807cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:37Z,use_quota=True,user_id='63821ced21e54c8ea28c36c447e78911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f0131e-c4df-41fd-a265-4afe46301948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f0131e-c4df-41fd-a265-4afe46301948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8caf6f8-1dde-4ba4-9330-6804f3282c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8caf6f8-1dde-4ba4-9330-6804f3282c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b9d635-9224-49de-9848-ae3d8fb2a05a', 'volume_name': 'volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bde1deb-365b-43d5-b5b6-0c3675eff48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bde1deb-365b-43d5-b5b6-0c3675eff48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e435f01-9491-4334-a2f4-d8927ea39a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:37 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Volume d5b9d635-9224-49de-9848-ae3d8fb2a05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a', 'volume_size': 1} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-692247467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b9d635-9224-49de-9848-ae3d8fb2a05a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9112c477f6974af08d64a11095807cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:37Z,use_quota=True,user_id='63821ced21e54c8ea28c36c447e78911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Creating volume d5b9d635-9224-49de-9848-ae3d8fb2a05a {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:59:37 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:37 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=135, name=volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a 1073741824" returned: 0 in 0.340s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.516s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e435f01-9491-4334-a2f4-d8927ea39a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e783f88-414a-44db-9c1d-85ecaf46ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:38 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Volume volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a (d5b9d635-9224-49de-9848-ae3d8fb2a05a): created successfully Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e783f88-414a-44db-9c1d-85ecaf46ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:38 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Flow 'volume_create_manager' (e7140bd3-6f85-4882-9f42-1a50990b2aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-cbf87739-78f2-4a94-8a61-7fed2de2a612 tempest-VolumesListTestJSON-173598036 None] Created volume successfully. Sep 10 13:59:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "cinder-d5b9d635-9224-49de-9848-ae3d8fb2a05a-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-d5b9d635-9224-49de-9848-ae3d8fb2a05a-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:43 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=35,cinder:UPDATE=53,cinder:DELETE=5,cinder:INSERT=11 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:59:43 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "cinder-quobyte-d5b9d635-9224-49de-9848-ae3d8fb2a05a" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-quobyte-d5b9d635-9224-49de-9848-ae3d8fb2a05a" acquired by "delete_volume" :: waited 0.018s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:44 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9276f947-4b17-4844-8fa5-3b7ce946c806]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a" returned: 0 in 0.424s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-d5b9d635-9224-49de-9848-ae3d8fb2a05a" returned: 0 in 0.087s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:44 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-quobyte-d5b9d635-9224-49de-9848-ae3d8fb2a05a" released by "delete_volume" :: held 0.673s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:44 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Created reservations ['29dabb03-6590-4d9d-88e4-6fa9e6997eb2', 'fa4e774c-8479-4ada-a1b5-70fd5137c9d9', '3ac80675-b70a-4121-bc0c-a6fc3e2b1ef9', '4ff7c5b3-3db0-4446-9a51-6eb23bde3067'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.120s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:59:45 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Deleted volume successfully. Sep 10 13:59:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-af7df6ab-9ff8-4b49-948d-6189cf0d2879 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-d5b9d635-9224-49de-9848-ae3d8fb2a05a-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "cinder-6434e8b7-cd6e-4829-88f0-3508617225af-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-6434e8b7-cd6e-4829-88f0-3508617225af-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "cinder-quobyte-6434e8b7-cd6e-4829-88f0-3508617225af" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-quobyte-6434e8b7-cd6e-4829-88f0-3508617225af" acquired by "delete_volume" :: waited 0.015s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[016949ef-db42-4a07-bd3f-3609e249cb35]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af" returned: 0 in 0.410s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-6434e8b7-cd6e-4829-88f0-3508617225af" returned: 0 in 0.092s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-quobyte-6434e8b7-cd6e-4829-88f0-3508617225af" released by "delete_volume" :: held 0.668s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Created reservations ['09105e9b-df18-4a19-b9f3-b3a16fb78e64', '8304c386-32c7-4ac5-bf94-79d8ee3dce06', '14d10c7e-3ec0-4243-a3f0-1fc7cab1792f', '146c000d-7108-4ba2-9257-44a96f23441b'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.097s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:59:47 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Deleted volume successfully. Sep 10 13:59:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-68d3de15-a5d4-46b8-9eab-ba91abc22a68 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-6434e8b7-cd6e-4829-88f0-3508617225af-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "cinder-84fed482-f9bc-45f7-91d6-543929463823-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-84fed482-f9bc-45f7-91d6-543929463823-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:48 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "cinder-quobyte-84fed482-f9bc-45f7-91d6-543929463823" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 13:59:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-quobyte-84fed482-f9bc-45f7-91d6-543929463823" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 13:59:48 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da4929-0e72-46f5-a2a1-4c69bbe0b70f]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823" returned: 0 in 0.414s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-84fed482-f9bc-45f7-91d6-543929463823" returned: 0 in 0.094s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-quobyte-84fed482-f9bc-45f7-91d6-543929463823" released by "delete_volume" :: held 0.669s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:49 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=52,cinder:UPDATE=62,cinder:DELETE=5,cinder:INSERT=24 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 13:59:49 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Created reservations ['a2a2e6a8-1b1c-45ec-970d-14856a6ae798', '033fbdac-d187-4cf4-b501-998199716f7d', '2e52e7eb-0d28-493e-9eb0-0f13dc94ab4c', '6659cf23-fbc2-42fa-b8be-779c4f07ac58'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 13:59:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Deleted volume successfully. Sep 10 13:59:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-71854c91-8328-48b6-bda8-1977192ce0d0 tempest-VolumesListTestJSON-173598036 None] Lock "cinder-84fed482-f9bc-45f7-91d6-543929463823-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 13:59:54 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Flow 'volume_create_manager' (6c720d57-d7ef-4410-85e1-e718f9711468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfd7c90-d8ba-42c0-8e76-7ce397aaf2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfd7c90-d8ba-42c0-8e76-7ce397aaf2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-70094983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510a115f-c78b-4239-9dc1-6e0ef789fe4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5409901e3034da991b953d421c7524b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:54Z,use_quota=True,user_id='f4564de431e447e0b46f29a3d10f2a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfeea78d-8ce9-4907-a0b6-e8ff4fb18971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfeea78d-8ce9-4907-a0b6-e8ff4fb18971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b27119-3ab0-4b95-8297-f28ffdf453df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b27119-3ab0-4b95-8297-f28ffdf453df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '510a115f-c78b-4239-9dc1-6e0ef789fe4f', 'volume_name': 'volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f', 'volume_size': 2}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614363d0-1015-4344-a32c-48b63eab613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614363d0-1015-4344-a32c-48b63eab613a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca65cff0-9ab9-4158-a803-c494bdc17857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:54 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Volume 510a115f-c78b-4239-9dc1-6e0ef789fe4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f', 'volume_size': 2} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T11:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-70094983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510a115f-c78b-4239-9dc1-6e0ef789fe4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5409901e3034da991b953d421c7524b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:54Z,use_quota=True,user_id='f4564de431e447e0b46f29a3d10f2a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Creating volume 510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 13:59:54 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 13:59:54 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f 2147483648 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:55 devstack quobyte-client[83260]: System call of process 99958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 13:59:55 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=136, name=volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f 2147483648" returned: 0 in 0.623s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f" returned: 0 in 0.113s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:55 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] <== create_volume: return (814ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 13:59:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca65cff0-9ab9-4158-a803-c494bdc17857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f', 'volume_size': 2}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2352cd2a-33e7-40ef-a450-8e2dd8f15694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 13:59:56 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Volume volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f (510a115f-c78b-4239-9dc1-6e0ef789fe4f): created successfully Sep 10 13:59:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2352cd2a-33e7-40ef-a450-8e2dd8f15694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 13:59:56 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Flow 'volume_create_manager' (6c720d57-d7ef-4410-85e1-e718f9711468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 13:59:56 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9617e834-bb3e-4d32-8994-b974772279f7 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Created volume successfully. Sep 10 13:59:57 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 13:59:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 13:59:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 13:59:57 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Creating offline snapshot af9be950-7714-4973-b239-10ac5bcd5d4b of volume 510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 13:59:57 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf444a-2bc4-4010-9268-72656b0161bc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 13:59:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f" returned: 0 in 0.530s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b 2G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:58 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=137, name=volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b 2G" returned: 0 in 0.471s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): qemu-img rebase -u -b volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "qemu-img rebase -u -b volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b" returned: 0 in 0.194s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b" returned: 0 in 0.101s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 13:59:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b" returned: 0 in 0.102s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.info" returned: 0 in 0.118s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 13:59:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 13:59:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.info" returned: 0 in 0.100s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 13:59:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 13:59:59 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0fb7e56e-7afd-4ba7-8950-3b9d90083bc1 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Create snapshot completed successfully Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "cinder-af9be950-7714-4973-b239-10ac5bcd5d4b-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-af9be950-7714-4973-b239-10ac5bcd5d4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:00:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "cinder-quobyte-510a115f-c78b-4239-9dc1-6e0ef789fe4f" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-quobyte-510a115f-c78b-4239-9dc1-6e0ef789fe4f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "cinder-quobyte-af9be950-7714-4973-b239-10ac5bcd5d4b" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-quobyte-af9be950-7714-4973-b239-10ac5bcd5d4b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Deleting offline snapshot af9be950-7714-4973-b239-10ac5bcd5d4b of volume 510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] snapshot_file for this snap is: volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c34ac8-23ff-4ca8-bfa8-7b329e4479a8]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:00:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b" returned: 0 in 0.494s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 14:00:01 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[134405a1-cc36-43f2-b264-b44dd7be6422]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:00:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f" returned: 0 in 0.635s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b" returned: 0 in 0.191s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f.af9be950-7714-4973-b239-10ac5bcd5d4b" returned: 0 in 0.082s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-quobyte-af9be950-7714-4973-b239-10ac5bcd5d4b" released by "_delete_snapshot" :: held 1.832s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-quobyte-510a115f-c78b-4239-9dc1-6e0ef789fe4f" released by "delete_snapshot" :: held 1.863s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:00:02 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Created reservations ['52d23883-347d-416a-b81b-130166180408', '2fa841da-47b6-4ec4-89f9-7bb03bb67f1c', '71f37602-2e43-4e85-8ae3-a30e5994ee4c', 'da91b8c0-d717-44eb-b08b-64bc98e0af10'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:00:03 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Delete snapshot completed successfully. Sep 10 14:00:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7aba7227-30e5-471d-8062-d1a279572993 tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-af9be950-7714-4973-b239-10ac5bcd5d4b-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "cinder-510a115f-c78b-4239-9dc1-6e0ef789fe4f-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-510a115f-c78b-4239-9dc1-6e0ef789fe4f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:00:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "cinder-quobyte-510a115f-c78b-4239-9dc1-6e0ef789fe4f" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-quobyte-510a115f-c78b-4239-9dc1-6e0ef789fe4f" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[031dc0a5-52bb-4ff9-adc5-3e2e04ebd7fc]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f" returned: 0 in 0.414s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-510a115f-c78b-4239-9dc1-6e0ef789fe4f" returned: 0 in 0.135s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-quobyte-510a115f-c78b-4239-9dc1-6e0ef789fe4f" released by "delete_volume" :: held 0.703s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Created reservations ['b1a3318a-c40f-4f4c-8961-823d52f8df60', 'adc6c8d6-8c63-4c34-8fe1-70f6ca39b3f8', '308d406c-90c7-49db-a837-3372ee9996b1', '120f060a-b89c-4d6d-a2e1-78c56cc9366c'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.109s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:00:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Deleted volume successfully. Sep 10 14:00:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-875cdca0-7e45-4c66-a9cb-c0c8829743ff tempest-VolumesSnapshotNegativeTestJSON-1072115478 None] Lock "cinder-510a115f-c78b-4239-9dc1-6e0ef789fe4f-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.107s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:00:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:00:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=19,cinder:SELECT=14,cinder:DELETE=2 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:00:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=29,cinder:UPDATE=46,cinder:DELETE=4,cinder:INSERT=14 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:01:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Flow 'volume_create_manager' (e717ed74-958c-4b74-a398-756af22c5811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c47aa9-d9e9-49b1-9247-de85767c6b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c47aa9-d9e9-49b1-9247-de85767c6b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-848666362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2d6731-ad26-4f2b-85b0-5cab816d0e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd15acf98b464420b5605119777e13c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:04Z,use_quota=True,user_id='ef7292f3fbcc497f801935fb5f62a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7875df24-80ac-499e-8cd9-b13b131f8854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7875df24-80ac-499e-8cd9-b13b131f8854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3d2545-4d96-4ddf-9879-c7fce0235f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3d2545-4d96-4ddf-9879-c7fce0235f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2d6731-ad26-4f2b-85b0-5cab816d0e2a', 'volume_name': 'volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d546df-2da3-489d-8c4b-3bf9b6705b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d546df-2da3-489d-8c4b-3bf9b6705b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a308ec3-ce5b-4794-b350-5b26301d0aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:01:04 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Volume 0c2d6731-ad26-4f2b-85b0-5cab816d0e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a', 'volume_size': 1} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-848666362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2d6731-ad26-4f2b-85b0-5cab816d0e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd15acf98b464420b5605119777e13c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:04Z,use_quota=True,user_id='ef7292f3fbcc497f801935fb5f62a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Creating volume 0c2d6731-ad26-4f2b-85b0-5cab816d0e2a {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:01:04 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:01:04 devstack quobyte-client[83260]: System call of process 100152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:01:04 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=139, name=volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a 1073741824" returned: 0 in 0.431s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a" returned: 0 in 0.133s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] <== create_volume: return (641ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:01:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:01:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a308ec3-ce5b-4794-b350-5b26301d0aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:01:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ec8d86-7432-44fd-9591-4007150df79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:01:05 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Volume volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a (0c2d6731-ad26-4f2b-85b0-5cab816d0e2a): created successfully Sep 10 14:01:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ec8d86-7432-44fd-9591-4007150df79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:01:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Flow 'volume_create_manager' (e717ed74-958c-4b74-a398-756af22c5811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:01:05 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f489ff2d-2c85-497d-bd40-1677e29f7acc tempest-TestMinimumBasicScenario-760499877 None] Created volume successfully. Sep 10 14:01:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:01:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:01:10 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[663f47f1-e36b-4a49-9f97-70ae6a7ee1e3]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:01:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a" returned: 0 in 0.651s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.737s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:01:11 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9', 'name': 'volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04b3c68d-ae3e-4df5-86e4-1239168726c7', 'enforce_multipath': True} {{(pid=83206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 14:01:11 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:01:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.468s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:01:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:01:12 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-cb0a048c-cb36-4337-be80-a96ff14b6eed req-422e1825-6e8a-43fd-ade6-97e207e4606d tempest-TestMinimumBasicScenario-760499877 None] attachment_update completed successfully. Sep 10 14:01:22 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:01:22 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1,cinder:SELECT=6 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:02:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:02:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:02:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.056s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:02:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:02:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:02:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.110s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:02:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:02:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.489s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:02:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:02:17 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.104s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:03:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:03:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-3986fd92-a726-430d-822d-1957986d7742 req-e611c686-e7c6-4dec-a7ed-142e74c09e91 tempest-TestMinimumBasicScenario-760499877 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:03:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [req-3986fd92-a726-430d-822d-1957986d7742 req-e611c686-e7c6-4dec-a7ed-142e74c09e91 tempest-TestMinimumBasicScenario-760499877 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:03:47 devstack cinder-volume[83206]: INFO cinder.volume.manager [req-3986fd92-a726-430d-822d-1957986d7742 req-e611c686-e7c6-4dec-a7ed-142e74c09e91 tempest-TestMinimumBasicScenario-760499877 None] Terminate volume connection completed successfully. Sep 10 14:03:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [req-3986fd92-a726-430d-822d-1957986d7742 req-e611c686-e7c6-4dec-a7ed-142e74c09e91 tempest-TestMinimumBasicScenario-760499877 None] Deleting attachment 04b3c68d-ae3e-4df5-86e4-1239168726c7. {{(pid=83206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 14:03:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Acquiring lock "cinder-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:03:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Lock "cinder-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:03:50 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Acquiring lock "cinder-quobyte-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Lock "cinder-quobyte-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a" acquired by "delete_volume" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67759fbc-b672-4346-8d75-8f0e10c8a34a]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a" returned: 0 in 0.457s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a" returned: 0 in 0.100s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:03:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Lock "cinder-quobyte-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a" released by "delete_volume" :: held 0.715s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Created reservations ['6c1d7886-643d-4e60-933b-2aceeac81fc6', 'd21ee16b-78b5-4d5d-9c3c-a9797a862e64', '2f950a82-8f05-4be2-b5c1-dd73018b254a', 'd4ac0346-35fb-4ddc-a426-1b36ca435a46'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.081s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:03:51 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Deleted volume successfully. Sep 10 14:03:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-5d051ce6-e749-49ed-abaa-acd62b809b9f tempest-TestMinimumBasicScenario-760499877 None] Lock "cinder-0c2d6731-ad26-4f2b-85b0-5cab816d0e2a-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:01 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:04:01 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:DELETE=1 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.120s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:11 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:04:16 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (5de91da3-371d-4d94-913f-d74a38b097a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f93d7b0-cadc-4404-b9bc-b17c2f7e4d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f93d7b0-cadc-4404-b9bc-b17c2f7e4d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072286110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2374357d-37d5-41d4-b9d9-8c28bc087620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:16Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6ece1a-e0e2-4c0f-8dd6-499e24eda257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6ece1a-e0e2-4c0f-8dd6-499e24eda257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353356c2-4906-4998-8110-1829c9633503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353356c2-4906-4998-8110-1829c9633503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2374357d-37d5-41d4-b9d9-8c28bc087620', 'volume_name': 'volume-2374357d-37d5-41d4-b9d9-8c28bc087620', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ce18eb-e734-4df0-a215-099eed05dec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ce18eb-e734-4df0-a215-099eed05dec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3703f15-2ee7-4dd6-a2cc-0b9d94bc9d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:16 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume 2374357d-37d5-41d4-b9d9-8c28bc087620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2374357d-37d5-41d4-b9d9-8c28bc087620', 'volume_size': 1} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072286110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2374357d-37d5-41d4-b9d9-8c28bc087620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:16Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Creating volume 2374357d-37d5-41d4-b9d9-8c28bc087620 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:04:16 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:16 devstack quobyte-client[83260]: System call of process 101053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:04:16 devstack quobyte-client[83260]: System call of process 101053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:04:16 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=140, name=volume-2374357d-37d5-41d4-b9d9-8c28bc087620, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620 1073741824" returned: 0 in 0.459s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620" returned: 0 in 0.163s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:17 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] <== create_volume: return (687ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:04:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3703f15-2ee7-4dd6-a2cc-0b9d94bc9d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2374357d-37d5-41d4-b9d9-8c28bc087620', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25352e8b-e7d4-48db-a8ee-4a2b74b0e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:17 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume volume-2374357d-37d5-41d4-b9d9-8c28bc087620 (2374357d-37d5-41d4-b9d9-8c28bc087620): created successfully Sep 10 14:04:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25352e8b-e7d4-48db-a8ee-4a2b74b0e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:17 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (5de91da3-371d-4d94-913f-d74a38b097a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:17 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-922f6a25-e4bf-4254-a79e-cd006c8a6241 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created volume successfully. Sep 10 14:04:18 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (f1612348-de05-4328-85be-a60e7672360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b723073d-9121-4e15-b2cb-1df3f7060bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b723073d-9121-4e15-b2cb-1df3f7060bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781576313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc0d646-b819-48be-af74-55934d85676c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:19Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ee0af-5ac6-4028-ae27-5df8bc05e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ee0af-5ac6-4028-ae27-5df8bc05e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d3767d-7634-459d-9c9d-7f2f31f1fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d3767d-7634-459d-9c9d-7f2f31f1fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc0d646-b819-48be-af74-55934d85676c', 'volume_name': 'volume-7cc0d646-b819-48be-af74-55934d85676c', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea53c6c-503f-499d-b878-15a58a105146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea53c6c-503f-499d-b878-15a58a105146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0cba3c-cad0-4364-a6f8-1c838d3b3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:19 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume 7cc0d646-b819-48be-af74-55934d85676c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc0d646-b819-48be-af74-55934d85676c', 'volume_size': 1} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781576313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc0d646-b819-48be-af74-55934d85676c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:19Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Creating volume 7cc0d646-b819-48be-af74-55934d85676c {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:04:19 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:19 devstack quobyte-client[83260]: System call of process 101089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:04:19 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=141, name=volume-7cc0d646-b819-48be-af74-55934d85676c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c 1073741824" returned: 0 in 0.565s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:19 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (74e24fc6-4882-47ed-91bb-ffdc5defebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe62136-fc55-48b9-8b74-cff6dcc79f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe62136-fc55-48b9-8b74-cff6dcc79f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338339786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61068153-8c40-434f-94b0-b25ede5378d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:19Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a8bd22-2e05-44b4-8bf7-9651fcfed521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a8bd22-2e05-44b4-8bf7-9651fcfed521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01731588-63dd-4fde-a4ec-9fa746c62878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01731588-63dd-4fde-a4ec-9fa746c62878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61068153-8c40-434f-94b0-b25ede5378d9', 'volume_name': 'volume-61068153-8c40-434f-94b0-b25ede5378d9', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75504dd9-3798-4a25-bc90-b08cf4725b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75504dd9-3798-4a25-bc90-b08cf4725b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c43838-04fb-4691-8513-3db4250400b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:20 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume 61068153-8c40-434f-94b0-b25ede5378d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61068153-8c40-434f-94b0-b25ede5378d9', 'volume_size': 1} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c" returned: 0 in 0.712s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] <== create_volume: return (1314ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338339786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61068153-8c40-434f-94b0-b25ede5378d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:19Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Creating volume 61068153-8c40-434f-94b0-b25ede5378d9 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:04:20 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:20 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=142, name=volume-61068153-8c40-434f-94b0-b25ede5378d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:04:20 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:20 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (1dfde443-a7cd-4285-9bab-9bba1524c913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f8e49c-c69f-4128-9e1e-c9c46ba8247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0cba3c-cad0-4364-a6f8-1c838d3b3536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc0d646-b819-48be-af74-55934d85676c', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e394e08-2881-4756-98a6-b2636d27f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9 1073741824" returned: 0 in 0.806s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f8e49c-c69f-4128-9e1e-c9c46ba8247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800275494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4b16b5-58b3-444e-9814-543c7933d1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:20Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59a9be4-541c-4365-b212-42820527b4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59a9be4-541c-4365-b212-42820527b4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c123c9d-61b4-4e8a-8585-a50264aa9cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c123c9d-61b4-4e8a-8585-a50264aa9cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4b16b5-58b3-444e-9814-543c7933d1cc', 'volume_name': 'volume-dd4b16b5-58b3-444e-9814-543c7933d1cc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d7404e-1d0f-4ee2-9dd0-69c76e1761f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d7404e-1d0f-4ee2-9dd0-69c76e1761f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22721680-d367-42b4-92bb-bb30fb7a0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:21 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume dd4b16b5-58b3-444e-9814-543c7933d1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4b16b5-58b3-444e-9814-543c7933d1cc', 'volume_size': 1} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:21 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume volume-7cc0d646-b819-48be-af74-55934d85676c (7cc0d646-b819-48be-af74-55934d85676c): created successfully Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e394e08-2881-4756-98a6-b2636d27f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (f1612348-de05-4328-85be-a60e7672360f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9" returned: 0 in 0.546s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:21 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-441953f9-9b1e-44a6-9424-dfc70c1937a0 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created volume successfully. Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] <== create_volume: return (1387ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:21 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (3bc6bd86-66d4-4bf5-a998-2158a92dbb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb9db74-2a96-484c-a1a4-4afcb0d78963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800275494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4b16b5-58b3-444e-9814-543c7933d1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:20Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Creating volume dd4b16b5-58b3-444e-9814-543c7933d1cc {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:04:21 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:04:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:22 devstack quobyte-client[83260]: System call of process 101103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:04:22 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=143, name=volume-dd4b16b5-58b3-444e-9814-543c7933d1cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb9db74-2a96-484c-a1a4-4afcb0d78963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1067394996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8df5c4-d269-4625-ac83-83e83d6d216c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:21Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc972cab-a459-4f50-859a-62ab08945a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc972cab-a459-4f50-859a-62ab08945a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8f1d69-cc7f-480f-aa7e-5b972a4eeea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8f1d69-cc7f-480f-aa7e-5b972a4eeea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8df5c4-d269-4625-ac83-83e83d6d216c', 'volume_name': 'volume-de8df5c4-d269-4625-ac83-83e83d6d216c', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a27f2fe-8f77-41ee-865b-450f0b89284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a27f2fe-8f77-41ee-865b-450f0b89284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c8fa47-0bf8-4945-a445-a53b5388164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume de8df5c4-d269-4625-ac83-83e83d6d216c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8df5c4-d269-4625-ac83-83e83d6d216c', 'volume_size': 1} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c43838-04fb-4691-8513-3db4250400b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61068153-8c40-434f-94b0-b25ede5378d9', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd8a03f-58e5-40c7-ab74-8cce1bfdde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (2c420122-10be-49c9-aa88-bbbf7b3aacc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037aabbe-be4a-4acf-91b0-8baa5397066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc 1073741824" returned: 0 in 0.584s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:22 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume volume-61068153-8c40-434f-94b0-b25ede5378d9 (61068153-8c40-434f-94b0-b25ede5378d9): created successfully Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd8a03f-58e5-40c7-ab74-8cce1bfdde53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (74e24fc6-4882-47ed-91bb-ffdc5defebfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037aabbe-be4a-4acf-91b0-8baa5397066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720096441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f88a115-9085-4a4c-b4fd-a1c3eef4690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:22Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5403b5e5-783a-4d7a-9853-a038c2bb32ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5403b5e5-783a-4d7a-9853-a038c2bb32ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaf91a7-d8b5-43bc-9ef3-eada56544cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaf91a7-d8b5-43bc-9ef3-eada56544cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f88a115-9085-4a4c-b4fd-a1c3eef4690a', 'volume_name': 'volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2508003f-c7c7-4100-983f-d2318d7f96ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2508003f-c7c7-4100-983f-d2318d7f96ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95d389e-6694-45b6-8a3a-6ec0a2638663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:22 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume 7f88a115-9085-4a4c-b4fd-a1c3eef4690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a', 'volume_size': 1} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc" returned: 0 in 0.429s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] <== create_volume: return (1036ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:04:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1067394996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8df5c4-d269-4625-ac83-83e83d6d216c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:21Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Creating volume de8df5c4-d269-4625-ac83-83e83d6d216c {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:04:23 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:23 devstack quobyte-client[83260]: System call of process 101108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:04:23 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=144, name=volume-de8df5c4-d269-4625-ac83-83e83d6d216c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22721680-d367-42b4-92bb-bb30fb7a0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4b16b5-58b3-444e-9814-543c7933d1cc', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926dc9fd-8027-472f-8935-3ee28fe8f292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5b03efd9-6a5c-4e30-bd6a-f69060ab244b tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created volume successfully. Sep 10 14:04:23 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume volume-dd4b16b5-58b3-444e-9814-543c7933d1cc (dd4b16b5-58b3-444e-9814-543c7933d1cc): created successfully Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926dc9fd-8027-472f-8935-3ee28fe8f292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (1dfde443-a7cd-4285-9bab-9bba1524c913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c 1073741824" returned: 0 in 0.468s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-9e484f46-58d8-40cb-8ab0-8f1dc9084f4e tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created volume successfully. Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c" returned: 0 in 0.239s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] <== create_volume: return (737ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720096441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f88a115-9085-4a4c-b4fd-a1c3eef4690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='491f19979b874191b3814b8fb4a27696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:22Z,use_quota=True,user_id='0fbf68b26d534132875987a26d9f0c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Creating volume 7f88a115-9085-4a4c-b4fd-a1c3eef4690a {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:04:23 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:04:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:24 devstack quobyte-client[83260]: System call of process 101112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:04:24 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=145, name=volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c8fa47-0bf8-4945-a445-a53b5388164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8df5c4-d269-4625-ac83-83e83d6d216c', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d2206f-f5dc-468c-b45d-87681e49a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:24 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume volume-de8df5c4-d269-4625-ac83-83e83d6d216c (de8df5c4-d269-4625-ac83-83e83d6d216c): created successfully Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d2206f-f5dc-468c-b45d-87681e49a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (3bc6bd86-66d4-4bf5-a998-2158a92dbb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:24 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-330aa002-63ee-4faf-b082-5a66e2bb7413 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created volume successfully. Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a 1073741824" returned: 0 in 0.669s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a" returned: 0 in 0.141s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] <== create_volume: return (875ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95d389e-6694-45b6-8a3a-6ec0a2638663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fda7732-8a8b-4c32-84fb-cc612e8b5bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:24 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a (7f88a115-9085-4a4c-b4fd-a1c3eef4690a): created successfully Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fda7732-8a8b-4c32-84fb-cc612e8b5bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:24 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Flow 'volume_create_manager' (2c420122-10be-49c9-aa88-bbbf7b3aacc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:25 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8264a683-b836-4995-9d8c-a52f837c2fbd tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created volume successfully. Sep 10 14:04:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-7f88a115-9085-4a4c-b4fd-a1c3eef4690a-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-7f88a115-9085-4a4c-b4fd-a1c3eef4690a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:25 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-quobyte-7f88a115-9085-4a4c-b4fd-a1c3eef4690a" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:25 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-7f88a115-9085-4a4c-b4fd-a1c3eef4690a" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[861cc4c0-f2fe-4d78-8ec0-0a9a04e7629d]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:04:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a" returned: 0 in 0.416s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f88a115-9085-4a4c-b4fd-a1c3eef4690a" returned: 0 in 0.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-7f88a115-9085-4a4c-b4fd-a1c3eef4690a" released by "delete_volume" :: held 0.690s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:26 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created reservations ['1c048b32-252c-4118-8667-8d95e33818f7', '8f686599-0fd7-499e-a9a6-5550039ce84b', 'f6f265ab-cd6d-4541-bbea-6e38d485112d', 'b41eae55-a14d-4fa2-bc25-2da93a48c42c'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.122s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:04:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Deleted volume successfully. Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7c1faadd-7776-4260-8ba5-9b3b068fb05c tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-7f88a115-9085-4a4c-b4fd-a1c3eef4690a-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-de8df5c4-d269-4625-ac83-83e83d6d216c-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-de8df5c4-d269-4625-ac83-83e83d6d216c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:28 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-quobyte-de8df5c4-d269-4625-ac83-83e83d6d216c" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-de8df5c4-d269-4625-ac83-83e83d6d216c" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b581f2a5-1a95-4950-acf4-95522159960e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c" returned: 0 in 0.437s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-de8df5c4-d269-4625-ac83-83e83d6d216c" returned: 0 in 0.090s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:28 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-de8df5c4-d269-4625-ac83-83e83d6d216c" released by "delete_volume" :: held 0.691s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created reservations ['6782898c-6a50-46ba-b1d9-64e25f7e6d22', 'b59e7587-c5bc-473e-9b04-4b2eff579f02', 'f44407fd-f00e-4ac2-9931-1e4187dc29f4', '81045c02-89f0-45b1-8cd4-ca821384ad99'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.084s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:04:29 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Deleted volume successfully. Sep 10 14:04:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b6af35db-dd21-437e-9238-2d137e1542d3 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-de8df5c4-d269-4625-ac83-83e83d6d216c-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-dd4b16b5-58b3-444e-9814-543c7933d1cc-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-dd4b16b5-58b3-444e-9814-543c7933d1cc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-quobyte-dd4b16b5-58b3-444e-9814-543c7933d1cc" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-dd4b16b5-58b3-444e-9814-543c7933d1cc" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1584a8-de15-41ed-86cf-5c2351e8d896]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc" returned: 0 in 0.419s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-dd4b16b5-58b3-444e-9814-543c7933d1cc" returned: 0 in 0.087s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-dd4b16b5-58b3-444e-9814-543c7933d1cc" released by "delete_volume" :: held 0.660s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created reservations ['442e924c-ebca-4414-a912-5d7d5be958c1', '042677b3-2baf-40f6-8fa0-8c1e00aacc92', '71bb8954-df8f-48a6-9643-dbb9aea3879f', 'e79f119a-1b39-484d-b5fa-d9d6a98081db'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.205s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:31 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:04:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Deleted volume successfully. Sep 10 14:04:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-cd46be11-225c-4aed-a31f-c293d7040777 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-dd4b16b5-58b3-444e-9814-543c7933d1cc-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-61068153-8c40-434f-94b0-b25ede5378d9-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-61068153-8c40-434f-94b0-b25ede5378d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:32 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-quobyte-61068153-8c40-434f-94b0-b25ede5378d9" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-61068153-8c40-434f-94b0-b25ede5378d9" acquired by "delete_volume" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:32 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4863dd1-b978-4fe4-b68e-8d38019be8fa]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:04:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9" returned: 0 in 0.409s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-61068153-8c40-434f-94b0-b25ede5378d9" returned: 0 in 0.089s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-61068153-8c40-434f-94b0-b25ede5378d9" released by "delete_volume" :: held 0.651s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created reservations ['2e9cb209-cf59-47f2-a040-5427633b44d1', 'd6adf950-e014-4ec3-99ec-bd089ed6b391', 'd29118d8-fb8e-4bbd-8b5b-391c48c8ac3d', '8465dfe3-604a-43e5-aa88-5b924001b93a'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.089s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:34 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:04:34 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Deleted volume successfully. Sep 10 14:04:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-43ef8ab6-6106-47a8-b98f-e2e97c5a5be4 tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-61068153-8c40-434f-94b0-b25ede5378d9-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-7cc0d646-b819-48be-af74-55934d85676c-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-7cc0d646-b819-48be-af74-55934d85676c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:35 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-quobyte-7cc0d646-b819-48be-af74-55934d85676c" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-7cc0d646-b819-48be-af74-55934d85676c" acquired by "delete_volume" :: waited 0.022s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab59410-ac41-4697-b8cf-c2226e0626ef]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c" returned: 0 in 0.401s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7cc0d646-b819-48be-af74-55934d85676c" returned: 0 in 0.086s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-7cc0d646-b819-48be-af74-55934d85676c" released by "delete_volume" :: held 0.646s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created reservations ['5114695f-4345-4958-b895-1bbf77e0dfe5', '3b584d27-d7d9-4408-b778-a44d7c9ecb24', 'a9cfb3f1-43b5-401a-bd5a-ea7a9e123515', '76bcbd2a-f0be-4e0d-a654-d4a32195d785'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.084s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:04:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Deleted volume successfully. Sep 10 14:04:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-81150a7a-c003-4832-bde1-2a0eaac0ad8f tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-7cc0d646-b819-48be-af74-55934d85676c-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-2374357d-37d5-41d4-b9d9-8c28bc087620-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-2374357d-37d5-41d4-b9d9-8c28bc087620-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:37 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "cinder-quobyte-2374357d-37d5-41d4-b9d9-8c28bc087620" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-2374357d-37d5-41d4-b9d9-8c28bc087620" acquired by "delete_volume" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[462a706a-6137-497f-b3c4-3f1c53bab5dd]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620" returned: 0 in 0.424s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-2374357d-37d5-41d4-b9d9-8c28bc087620" returned: 0 in 0.092s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-quobyte-2374357d-37d5-41d4-b9d9-8c28bc087620" released by "delete_volume" :: held 0.680s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Created reservations ['3dbc5549-b7cf-46df-9673-21c493d18cde', '05cf1b7a-efd4-4f44-92e0-6e8be343f81c', '8c069187-49bf-4f3b-8dbd-5c46eaa55a1e', '67a94012-44be-4de0-8bfb-070b65fea1ff'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.083s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:04:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Deleted volume successfully. Sep 10 14:04:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-13f56b73-f620-459d-9690-05f9d890480a tempest-CreateVolumesFromSourceVolumeTest-93282155 None] Lock "cinder-2374357d-37d5-41d4-b9d9-8c28bc087620-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:04:48 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=36,cinder:UPDATE=70,cinder:DELETE=5,cinder:INSERT=13 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:04:48 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=51,cinder:SELECT=37,cinder:DELETE=7,cinder:INSERT=11 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:04:59 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (5713fad6-1655-4f4c-a92c-ea23727d308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12891e5d-81a3-45f9-99bd-97a07e7704a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12891e5d-81a3-45f9-99bd-97a07e7704a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317360715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e33896-5f47-4ced-9ed0-0a372bf32471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:59Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b394b746-94ed-4c48-b687-deeca977b436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b394b746-94ed-4c48-b687-deeca977b436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cea490e-7879-4910-b2e3-4d1564df8e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cea490e-7879-4910-b2e3-4d1564df8e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e33896-5f47-4ced-9ed0-0a372bf32471', 'volume_name': 'volume-48e33896-5f47-4ced-9ed0-0a372bf32471', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4626c46a-6817-4786-ba62-495f47f8c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4626c46a-6817-4786-ba62-495f47f8c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8cc075-05f5-426e-bb12-11768b956863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:04:59 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume 48e33896-5f47-4ced-9ed0-0a372bf32471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e33896-5f47-4ced-9ed0-0a372bf32471', 'volume_size': 1} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317360715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e33896-5f47-4ced-9ed0-0a372bf32471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:59Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Creating volume 48e33896-5f47-4ced-9ed0-0a372bf32471 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:04:59 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:04:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:04:59 devstack quobyte-client[83260]: System call of process 101199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:04:59 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=146, name=volume-48e33896-5f47-4ced-9ed0-0a372bf32471, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (94f7ad4e-2a17-4ffe-87f2-301ac4e0d037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f46020d-b209-4e3c-91c7-8deb29ae4f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f46020d-b209-4e3c-91c7-8deb29ae4f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-41733072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dedb88b-a12e-4230-83f1-ba1393fea4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:59Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc4af77-a361-4df3-9b8f-1f179db1f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc4af77-a361-4df3-9b8f-1f179db1f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db278ea-c9e5-4de7-9385-99e3106db2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db278ea-c9e5-4de7-9385-99e3106db2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dedb88b-a12e-4230-83f1-ba1393fea4f1', 'volume_name': 'volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f83f07-2053-4cc1-9251-101320e7e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f83f07-2053-4cc1-9251-101320e7e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1217217-09e7-484a-a119-db8910e5343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Volume 5dedb88b-a12e-4230-83f1-ba1393fea4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1', 'volume_size': 1} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471 1073741824" returned: 0 in 0.897s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (8c63e6c0-f22a-4c93-8711-a1884285e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c898e59-f4d1-4588-99ca-dcc7d5208c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c898e59-f4d1-4588-99ca-dcc7d5208c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-288638655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fd6854-17e2-4289-8f8e-7de1d299bd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:00Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c63de52-27ec-4948-b3ba-4ac606204f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c63de52-27ec-4948-b3ba-4ac606204f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34249c7-e678-41e4-8e30-684cf33b1412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34249c7-e678-41e4-8e30-684cf33b1412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8fd6854-17e2-4289-8f8e-7de1d299bd5a', 'volume_name': 'volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d8e02-8832-471f-a24c-1168eb1ef681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d8e02-8832-471f-a24c-1168eb1ef681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc202877-037c-4bc7-b26d-f8787cf88844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:00 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Volume b8fd6854-17e2-4289-8f8e-7de1d299bd5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a', 'volume_size': 1} Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:00 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (dd8a166b-89f0-4db3-adbe-22c6bede1711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b709d6f-6c24-4fbe-a488-8a45cabc33be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471" returned: 0 in 0.704s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] <== create_volume: return (1673ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-41733072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dedb88b-a12e-4230-83f1-ba1393fea4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:59Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Creating volume 5dedb88b-a12e-4230-83f1-ba1393fea4f1 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:01 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:01 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=147, name=volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b709d6f-6c24-4fbe-a488-8a45cabc33be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-870382525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f0eacf-2c6a-4507-9a60-ac12645eea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:00Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49f116c-8ae1-49ea-8aca-1e366bf64d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49f116c-8ae1-49ea-8aca-1e366bf64d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6fc632-5dfb-4575-a3f2-adb035805c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6fc632-5dfb-4575-a3f2-adb035805c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f0eacf-2c6a-4507-9a60-ac12645eea8e', 'volume_name': 'volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc753da3-64dc-4e54-b609-dbaabdb21879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc753da3-64dc-4e54-b609-dbaabdb21879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e228a778-8914-40e8-a701-911f1a6ba748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:01 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Volume 82f0eacf-2c6a-4507-9a60-ac12645eea8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e', 'volume_size': 1} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:01 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (e0a159ab-10ed-4b4a-86cb-65bbe1a2920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffe5be7-c25c-4095-80e1-866fce883f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8cc075-05f5-426e-bb12-11768b956863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e33896-5f47-4ced-9ed0-0a372bf32471', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:01 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6d8776-5961-4f7a-b3ac-e03cbf093c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:02 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume volume-48e33896-5f47-4ced-9ed0-0a372bf32471 (48e33896-5f47-4ced-9ed0-0a372bf32471): created successfully Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6d8776-5961-4f7a-b3ac-e03cbf093c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (5713fad6-1655-4f4c-a92c-ea23727d308f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffe5be7-c25c-4095-80e1-866fce883f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811003826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cefc6a-78b4-4228-b835-7cb60fc45377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:01Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26d442-025c-4083-9464-6aeda6920b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26d442-025c-4083-9464-6aeda6920b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d46eb0-7010-486f-a44b-5a68334aa3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d46eb0-7010-486f-a44b-5a68334aa3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36cefc6a-78b4-4228-b835-7cb60fc45377', 'volume_name': 'volume-36cefc6a-78b4-4228-b835-7cb60fc45377', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753d66f1-fb05-457d-883a-6e04c117b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753d66f1-fb05-457d-883a-6e04c117b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d930fca-e652-4c0b-bc20-4f580be848e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:02 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Volume 36cefc6a-78b4-4228-b835-7cb60fc45377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36cefc6a-78b4-4228-b835-7cb60fc45377', 'volume_size': 1} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1 1073741824" returned: 0 in 0.924s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:02 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-bc3b365a-07e2-44fb-a83d-2ebc0129d27a tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created volume successfully. Sep 10 14:05:02 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (47c54115-8dfa-44a7-bb53-aa17235f1673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596bf0d1-38aa-47d6-aa62-d97aec1cfe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1" returned: 0 in 0.584s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] <== create_volume: return (1532ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-288638655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fd6854-17e2-4289-8f8e-7de1d299bd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:00Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Creating volume b8fd6854-17e2-4289-8f8e-7de1d299bd5a {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:02 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:02 devstack quobyte-client[83260]: System call of process 101208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:02 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=148, name=volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596bf0d1-38aa-47d6-aa62-d97aec1cfe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719578620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb0b62d-2545-4969-8c54-46f129102ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:02Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016161b4-f8f6-4809-940c-171933069727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016161b4-f8f6-4809-940c-171933069727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de616b-315d-476b-9a60-f5353d71274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de616b-315d-476b-9a60-f5353d71274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb0b62d-2545-4969-8c54-46f129102ce2', 'volume_name': 'volume-4bb0b62d-2545-4969-8c54-46f129102ce2', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3701b22-4ffa-4830-8187-fbb0dccb95e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3701b22-4ffa-4830-8187-fbb0dccb95e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3ccaf5-f92e-4bb6-b172-f8a49fe59808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:03 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Volume 4bb0b62d-2545-4969-8c54-46f129102ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb0b62d-2545-4969-8c54-46f129102ce2', 'volume_size': 1} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1217217-09e7-484a-a119-db8910e5343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9e5083-f48a-40c8-a3bb-30805f1fb964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a 1073741824" returned: 0 in 0.762s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:03 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Volume volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1 (5dedb88b-a12e-4230-83f1-ba1393fea4f1): created successfully Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9e5083-f48a-40c8-a3bb-30805f1fb964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:03 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (94f7ad4e-2a17-4ffe-87f2-301ac4e0d037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a" returned: 0 in 0.558s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] <== create_volume: return (1342ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.318s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-870382525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f0eacf-2c6a-4507-9a60-ac12645eea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:00Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Creating volume 82f0eacf-2c6a-4507-9a60-ac12645eea8e {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:04 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:04 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=149, name=volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Flow 'volume_create_manager' (dc305d94-75b9-4b98-9992-b1f8b86002c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c990d790-3ccd-4cdf-965c-a8f413e4ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (29895da5-2805-40ed-9aef-988b10986b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de7c398-b619-4536-8281-4ba8b3c3433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:04 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-61321869-14b4-471d-99e8-fd72408fc657 tempest-CreateVolumesFromImageTest-1736647008 None] Created volume successfully. Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de7c398-b619-4536-8281-4ba8b3c3433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228600467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ca4c7-8b20-4432-92eb-cef5b3495f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:03Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f5d3c1-b2c6-4d64-941d-2028d6991d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f5d3c1-b2c6-4d64-941d-2028d6991d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231168da-857e-467d-9762-2072bed0445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231168da-857e-467d-9762-2072bed0445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9ca4c7-8b20-4432-92eb-cef5b3495f3f', 'volume_name': 'volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671b1221-c177-4f83-a613-fb47499121b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671b1221-c177-4f83-a613-fb47499121b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af74848e-1134-4274-99dc-678cab430740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:04 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume 7f9ca4c7-8b20-4432-92eb-cef5b3495f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f', 'volume_size': 1} Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:04 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:04 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (1fae4840-724c-4baf-9786-dac7aaa20ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c790f2e1-9438-4767-8f08-76649a9223fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (c0f73343-c432-42b2-b3f2-a30fc2c58046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793c7b02-6d13-436a-9b61-a00245b30cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c990d790-3ccd-4cdf-965c-a8f413e4ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebed19e-c0c0-4fa7-af97-24d4b483f36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13852b0342054a429c01b01bedcc750c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:04Z,use_quota=True,user_id='71a373cfc86c440da53ca8f42d0176c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b493ec-8469-4ef3-a621-bc105d2f18ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b493ec-8469-4ef3-a621-bc105d2f18ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17bede4-e33d-42f5-96a4-ccc12df7e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c790f2e1-9438-4767-8f08-76649a9223fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513739630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176094a6-2304-4de8-92b2-6d9da3af7ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:04Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7993504e-c13d-46a1-b423-d2c9eba539e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7993504e-c13d-46a1-b423-d2c9eba539e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc44b908-f178-43bf-a910-509f13893d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc44b908-f178-43bf-a910-509f13893d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176094a6-2304-4de8-92b2-6d9da3af7ce3', 'volume_name': 'volume-176094a6-2304-4de8-92b2-6d9da3af7ce3', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718bdf4c-8a1a-474d-8583-f84223b316d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718bdf4c-8a1a-474d-8583-f84223b316d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa1c288-18cd-4560-830b-b84413843e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume 176094a6-2304-4de8-92b2-6d9da3af7ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176094a6-2304-4de8-92b2-6d9da3af7ce3', 'volume_size': 1} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e 1073741824" returned: 0 in 1.105s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793c7b02-6d13-436a-9b61-a00245b30cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-123708676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d0a693-e2d8-4d67-84ee-8949884c9378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:04Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f6a8cf-ea9c-4f50-b0c7-89141bf5fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f6a8cf-ea9c-4f50-b0c7-89141bf5fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55151fb8-fd1a-43d4-98a0-69502b2cacdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55151fb8-fd1a-43d4-98a0-69502b2cacdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d0a693-e2d8-4d67-84ee-8949884c9378', 'volume_name': 'volume-35d0a693-e2d8-4d67-84ee-8949884c9378', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d162ea60-3b20-4223-aabf-5ef63acec82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d162ea60-3b20-4223-aabf-5ef63acec82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38efda9c-53ce-4251-b0ba-f91a6627d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume 35d0a693-e2d8-4d67-84ee-8949884c9378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d0a693-e2d8-4d67-84ee-8949884c9378', 'volume_size': 1} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (1d318062-a44c-47c2-ad9f-161e5dff4472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5827db-8e54-42d6-aef4-9884280f77a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc202877-037c-4bc7-b26d-f8787cf88844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab7c50d-7631-4c86-a221-df9d5cf68df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e" returned: 0 in 0.732s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] <== create_volume: return (1898ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.909s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811003826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cefc6a-78b4-4228-b835-7cb60fc45377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:01Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Creating volume 36cefc6a-78b4-4228-b835-7cb60fc45377 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:06 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:06 devstack quobyte-client[83260]: System call of process 101217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:06 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=150, name=volume-36cefc6a-78b4-4228-b835-7cb60fc45377, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5827db-8e54-42d6-aef4-9884280f77a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357497909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635367ec-5c1d-4b28-ac04-7584600f1bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:05Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c237f711-2c17-4337-9041-191686854fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c237f711-2c17-4337-9041-191686854fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd867cd-0221-4ff4-9c2b-2d0206eea817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd867cd-0221-4ff4-9c2b-2d0206eea817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635367ec-5c1d-4b28-ac04-7584600f1bc0', 'volume_name': 'volume-635367ec-5c1d-4b28-ac04-7584600f1bc0', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2df23e-3473-43e1-bf60-25ae783762d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2df23e-3473-43e1-bf60-25ae783762d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a6420b-e09b-43c3-ba6c-98d176775a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume 635367ec-5c1d-4b28-ac04-7584600f1bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635367ec-5c1d-4b28-ac04-7584600f1bc0', 'volume_size': 1} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Volume volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a (b8fd6854-17e2-4289-8f8e-7de1d299bd5a): created successfully Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab7c50d-7631-4c86-a221-df9d5cf68df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (8c63e6c0-f22a-4c93-8711-a1884285e13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e228a778-8914-40e8-a701-911f1a6ba748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2bca56-1350-415d-be0f-0eda25720425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (e88b1727-0294-4db8-8653-8e370346e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2b5ce4-e694-454c-b8c0-99a1263d11f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17bede4-e33d-42f5-96a4-ccc12df7e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ebed19e-c0c0-4fa7-af97-24d4b483f36c', 'volume_name': 'volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c', 'volume_size': 1, 'image_id': 'c5bbf2e3-0c20-4026-bec0-73cd8418be32', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62d6804058185f244664c569bcd07aad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13852b0342054a429c01b01bedcc750c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57a290580f66e0761f901609b2a7af59e409e03ed89123a2f7865a3d547abaafdc3c668f4381c502fa52c3b4f3148969d5a3b3315dc9e8ed0f7d7925fb1f0b11', 'id': 'c5bbf2e3-0c20-4026-bec0-73cd8418be32', 'created_at': datetime.datetime(2025, 9, 10, 12, 4, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5bbf2e3-0c20-4026-bec0-73cd8418be32/file', 'properties': {}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804c46af-97f3-4a5a-8205-26703a933858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804c46af-97f3-4a5a-8205-26703a933858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e23a75-5d48-4764-abf7-73df0bba6118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Volume 3ebed19e-c0c0-4fa7-af97-24d4b483f36c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c', 'volume_size': 1, 'image_id': 'c5bbf2e3-0c20-4026-bec0-73cd8418be32', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62d6804058185f244664c569bcd07aad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13852b0342054a429c01b01bedcc750c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57a290580f66e0761f901609b2a7af59e409e03ed89123a2f7865a3d547abaafdc3c668f4381c502fa52c3b4f3148969d5a3b3315dc9e8ed0f7d7925fb1f0b11', 'id': 'c5bbf2e3-0c20-4026-bec0-73cd8418be32', 'created_at': datetime.datetime(2025, 9, 10, 12, 4, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5bbf2e3-0c20-4026-bec0-73cd8418be32/file', 'properties': {}}, 'image_service': } Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Cloning 3ebed19e-c0c0-4fa7-af97-24d4b483f36c from image c5bbf2e3-0c20-4026-bec0-73cd8418be32 at location (None, None). {{(pid=83206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2b5ce4-e694-454c-b8c0-99a1263d11f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645599665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e52ca4-d394-4f8b-b600-fa49e2fb0121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:06Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae63099-3759-46f1-a848-950410c91901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae63099-3759-46f1-a848-950410c91901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a3e192-6d79-4e00-b89e-4e418b12fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a3e192-6d79-4e00-b89e-4e418b12fe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e52ca4-d394-4f8b-b600-fa49e2fb0121', 'volume_name': 'volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19719964-ab87-4368-a35f-6cb814fa42c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19719964-ab87-4368-a35f-6cb814fa42c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33081c42-aac3-43c9-843a-34410d4b6d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume 40e52ca4-d394-4f8b-b600-fa49e2fb0121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121', 'volume_size': 1} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:06 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ef82c3ce-9ffa-46bc-9822-fa6a691e8ca7 tempest-CreateVolumesFromImageTest-1736647008 None] Created volume successfully. Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377 1073741824" returned: 0 in 0.788s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:06 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Volume volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e (82f0eacf-2c6a-4507-9a60-ac12645eea8e): created successfully Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2bca56-1350-415d-be0f-0eda25720425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (dd8a166b-89f0-4db3-adbe-22c6bede1711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 14:05:07 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Image download 0.00 MB at 0.00 MB/s Sep 10 14:05:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-08c4163a-10bc-4d68-bffd-7483371fb1ef tempest-CreateVolumesFromImageTest-1736647008 None] Created volume successfully. Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377" returned: 0 in 0.420s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] <== create_volume: return (1239ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.072s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719578620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb0b62d-2545-4969-8c54-46f129102ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a40fded06f423ebe677d7a73729ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:02Z,use_quota=True,user_id='cf5c135482e440c9bebf0ec41ce122e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Creating volume 4bb0b62d-2545-4969-8c54-46f129102ce2 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:07 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:07 devstack quobyte-client[83260]: System call of process 101221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:07 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=151, name=volume-4bb0b62d-2545-4969-8c54-46f129102ce2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d930fca-e652-4c0b-bc20-4f580be848e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36cefc6a-78b4-4228-b835-7cb60fc45377', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266a0c74-f723-4822-9147-bdadb44d53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e9ba82-3bcf-4dd9-af83-a68ea78be5d9]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:08 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Volume volume-36cefc6a-78b4-4228-b835-7cb60fc45377 (36cefc6a-78b4-4228-b835-7cb60fc45377): created successfully Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266a0c74-f723-4822-9147-bdadb44d53a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (e0a159ab-10ed-4b4a-86cb-65bbe1a2920f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2 1073741824" returned: 0 in 0.892s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:08 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD Sep 10 14:05:08 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2" returned: 0 in 0.163s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] <== create_volume: return (1129ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.529s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228600467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ca4c7-8b20-4432-92eb-cef5b3495f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:03Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Creating volume 7f9ca4c7-8b20-4432-92eb-cef5b3495f3f {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:08 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:08 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=152, name=volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:08 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-41fbcc30-0ccc-4583-a8d8-a84d7da0bcd5 tempest-CreateVolumesFromImageTest-1736647008 None] Created volume successfully. Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3ccaf5-f92e-4bb6-b172-f8a49fe59808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb0b62d-2545-4969-8c54-46f129102ce2', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:08 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffee41ed-efaa-41a4-a275-9347a9043ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:09 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Volume volume-4bb0b62d-2545-4969-8c54-46f129102ce2 (4bb0b62d-2545-4969-8c54-46f129102ce2): created successfully Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffee41ed-efaa-41a4-a275-9347a9043ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Flow 'volume_create_manager' (47c54115-8dfa-44a7-bb53-aa17235f1673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f 1073741824" returned: 0 in 0.544s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:09 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a33f01a7-2b51-4708-97d6-20d8a1f5e04b tempest-CreateVolumesFromImageTest-1736647008 None] Created volume successfully. Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-4bb0b62d-2545-4969-8c54-46f129102ce2-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f" returned: 0 in 0.550s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] <== create_volume: return (1126ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-4bb0b62d-2545-4969-8c54-46f129102ce2-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.535s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513739630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176094a6-2304-4de8-92b2-6d9da3af7ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:04Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Creating volume 176094a6-2304-4de8-92b2-6d9da3af7ce3 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:09 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:09 devstack quobyte-client[83260]: System call of process 101231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:09 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=153, name=volume-176094a6-2304-4de8-92b2-6d9da3af7ce3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af74848e-1134-4274-99dc-678cab430740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf5618a-0b6f-47b7-bc70-e16192687581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3 1073741824" returned: 0 in 0.787s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:10 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f (7f9ca4c7-8b20-4432-92eb-cef5b3495f3f): created successfully Sep 10 14:05:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf5618a-0b6f-47b7-bc70-e16192687581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:10 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (29895da5-2805-40ed-9aef-988b10986b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:10 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 10 14:05:11 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-quobyte-4bb0b62d-2545-4969-8c54-46f129102ce2" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD" returned: 0 in 3.503s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3" returned: 0 in 0.752s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] <== create_volume: return (1718ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:11 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-28b7f989-fc04-4b1c-9f42-e4ba8dec9088 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created volume successfully. Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.954s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-123708676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d0a693-e2d8-4d67-84ee-8949884c9378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:04Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Creating volume 35d0a693-e2d8-4d67-84ee-8949884c9378 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:11 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:05:11 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:11 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:11 devstack quobyte-client[83260]: System call of process 101238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:11 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=154, name=volume-35d0a693-e2d8-4d67-84ee-8949884c9378, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-4bb0b62d-2545-4969-8c54-46f129102ce2" acquired by "delete_volume" :: waited 1.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa1c288-18cd-4560-830b-b84413843e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176094a6-2304-4de8-92b2-6d9da3af7ce3', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a1343d-f0ec-443d-9c69-50abedeb40b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0242833d-d8f8-417f-a2f6-8e1b89cbea67]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.779s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378 1073741824" returned: 0 in 1.081s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:13 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume volume-176094a6-2304-4de8-92b2-6d9da3af7ce3 (176094a6-2304-4de8-92b2-6d9da3af7ce3): created successfully Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a1343d-f0ec-443d-9c69-50abedeb40b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (1fae4840-724c-4baf-9786-dac7aaa20ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378" returned: 0 in 0.404s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:13 devstack quobyte-client[83260]: System call of process 101244 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] <== create_volume: return (1545ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.799s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357497909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635367ec-5c1d-4b28-ac04-7584600f1bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:05Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Creating volume 635367ec-5c1d-4b28-ac04-7584600f1bc0 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:13 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:13 devstack quobyte-client[83260]: System call of process 101248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:13 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=155, name=volume-635367ec-5c1d-4b28-ac04-7584600f1bc0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38efda9c-53ce-4251-b0ba-f91a6627d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d0a693-e2d8-4d67-84ee-8949884c9378', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5779e0-583c-4c55-87fe-b1a191ad1cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:13 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-d152e273-08ee-4950-bf50-340fd6e13f9f tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created volume successfully. Sep 10 14:05:13 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume volume-35d0a693-e2d8-4d67-84ee-8949884c9378 (35d0a693-e2d8-4d67-84ee-8949884c9378): created successfully Sep 10 14:05:13 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5779e0-583c-4c55-87fe-b1a191ad1cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (c0f73343-c432-42b2-b3f2-a30fc2c58046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2" returned: 0 in 1.634s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0 1073741824" returned: 0 in 1.147s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:14 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 10 14:05:14 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8932daf4-406f-46af-9195-e979b4b94548 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created volume successfully. Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-4bb0b62d-2545-4969-8c54-46f129102ce2" returned: 0 in 0.728s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD" returned: 1 in 3.585s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Temporary image c5bbf2e3-0c20-4026-bec0-73cd8418be32 is fetched for user 71a373cfc86c440da53ca8f42d0176c1. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0" returned: 0 in 0.389s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-4bb0b62d-2545-4969-8c54-46f129102ce2" released by "delete_volume" :: held 2.685s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] <== create_volume: return (1675ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.167s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645599665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e52ca4-d394-4f8b-b600-fa49e2fb0121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5552887eed14a999f9d8c045af045a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:06Z,use_quota=True,user_id='00e9915b7b294922b31994d4a6087b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Creating volume 40e52ca4-d394-4f8b-b600-fa49e2fb0121 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:15 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:15 devstack quobyte-client[83260]: System call of process 101256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:15 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=156, name=volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a6420b-e09b-43c3-ba6c-98d176775a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635367ec-5c1d-4b28-ac04-7584600f1bc0', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1843aeee-babb-42bb-a748-b8430823439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121 1073741824" returned: 0 in 0.591s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:15 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume volume-635367ec-5c1d-4b28-ac04-7584600f1bc0 (635367ec-5c1d-4b28-ac04-7584600f1bc0): created successfully Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1843aeee-babb-42bb-a748-b8430823439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:15 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (1d318062-a44c-47c2-ad9f-161e5dff4472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-cfa04534-ff24-4bd1-b712-c274e65d4c2b tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created volume successfully. Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4eaf28-0ed4-471e-9519-192ca6ac287d]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121" returned: 0 in 0.519s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] <== create_volume: return (1357ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33081c42-aac3-43c9-843a-34410d4b6d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19e98b1-eaba-4a77-86b9-01dd24ffa644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Created reservations ['c366dd1f-d5ac-42c9-9e87-716102bd9ec7', 'd3b03793-1597-4399-9aaf-109aeac2b434', '9842fd3e-eb98-4a32-8f04-cab70fc2a972', '22aaf0db-1417-4d98-8e03-9d2909ecd7e4'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:16 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121 (40e52ca4-d394-4f8b-b600-fa49e2fb0121): created successfully Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19e98b1-eaba-4a77-86b9-01dd24ffa644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Flow 'volume_create_manager' (e88b1727-0294-4db8-8653-8e370346e625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:16 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD Sep 10 14:05:16 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-4753d6db-7aff-453a-9bce-57b8aac55b80 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created volume successfully. Sep 10 14:05:16 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.137s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:16 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:17 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Deleted volume successfully. Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-55b0bac9-f32f-4093-8d74-0707e30bda92 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-4bb0b62d-2545-4969-8c54-46f129102ce2-delete_volume" released by "delete_volume" :: held 7.576s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-36cefc6a-78b4-4228-b835-7cb60fc45377-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-36cefc6a-78b4-4228-b835-7cb60fc45377-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-40e52ca4-d394-4f8b-b600-fa49e2fb0121-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-40e52ca4-d394-4f8b-b600-fa49e2fb0121-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:17 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-quobyte-36cefc6a-78b4-4228-b835-7cb60fc45377" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:17 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-quobyte-40e52ca4-d394-4f8b-b600-fa49e2fb0121" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-36cefc6a-78b4-4228-b835-7cb60fc45377" acquired by "delete_volume" :: waited 0.032s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef56ed-b41b-49bc-9738-ec2cccdabc02]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:17 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:18 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-40e52ca4-d394-4f8b-b600-fa49e2fb0121" acquired by "delete_volume" :: waited 0.296s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:18 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[863dcd06-d7bd-4364-ac0e-54bb347a9f41]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:18 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:18 devstack quobyte-client[83260]: System call of process 101263 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377" returned: 0 in 1.070s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:19 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 10 14:05:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD" returned: 0 in 3.301s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121" returned: 0 in 1.313s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-36cefc6a-78b4-4228-b835-7cb60fc45377" returned: 0 in 0.539s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:19 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-40e52ca4-d394-4f8b-b600-fa49e2fb0121" returned: 0 in 0.360s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-36cefc6a-78b4-4228-b835-7cb60fc45377" released by "delete_volume" :: held 2.266s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:20 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD Sep 10 14:05:20 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-40e52ca4-d394-4f8b-b600-fa49e2fb0121" released by "delete_volume" :: held 2.236s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created reservations ['14cb9189-7450-4b78-9f12-9642522f04db', 'ef49951b-dec2-4c61-a30a-28d0ee9bc86c', '002fd50f-1407-4777-8608-77235e32ad98', '1b722811-17bc-461d-b33d-72f9cf27bddf'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Created reservations ['e0e4dec5-a759-4f36-95b3-65b1be9adc16', '5f2d0b0e-315f-4d8a-abf5-5d70eb67d004', '4a23cda9-94ee-400a-9cb6-8bdbc2f96b6a', '9bce3c72-45eb-4730-93ab-bde1a43f5515'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:20 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-82f0eacf-2c6a-4507-9a60-ac12645eea8e-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-635367ec-5c1d-4b28-ac04-7584600f1bc0-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.655s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-82f0eacf-2c6a-4507-9a60-ac12645eea8e-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:21 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Deleted volume successfully. Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-635367ec-5c1d-4b28-ac04-7584600f1bc0-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-92440522-651e-4233-a550-bd58e6b07290 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-36cefc6a-78b4-4228-b835-7cb60fc45377-delete_volume" released by "delete_volume" :: held 4.701s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:22 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-quobyte-82f0eacf-2c6a-4507-9a60-ac12645eea8e" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.755s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:22 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-quobyte-635367ec-5c1d-4b28-ac04-7584600f1bc0" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:22 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Deleted volume successfully. Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-82f0eacf-2c6a-4507-9a60-ac12645eea8e" acquired by "delete_volume" :: waited 0.108s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de90ddbd-d949-40fd-b591-f1fffe922a18]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:22 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-635367ec-5c1d-4b28-ac04-7584600f1bc0" acquired by "delete_volume" :: waited 0.334s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:22 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8421bb9-2ad7-4042-8750-7dfcf50db7a3]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41240aaa-073e-4803-809d-16e106d4a280 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-40e52ca4-d394-4f8b-b600-fa49e2fb0121-delete_volume" released by "delete_volume" :: held 5.359s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD" returned: 1 in 3.783s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebed19e-c0c0-4fa7-af97-24d4b483f36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13852b0342054a429c01b01bedcc750c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:04Z,use_quota=True,user_id='71a373cfc86c440da53ca8f42d0176c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Creating volume 3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:23 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e" returned: 0 in 0.881s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:23 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=157, name=volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:23 devstack quobyte-client[83260]: System call of process 101320 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-82f0eacf-2c6a-4507-9a60-ac12645eea8e" returned: 0 in 0.172s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:23 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-82f0eacf-2c6a-4507-9a60-ac12645eea8e" released by "delete_volume" :: held 1.314s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c 1073741824" returned: 0 in 0.716s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0" returned: 0 in 1.289s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" returned: 0 in 0.500s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] <== create_volume: return (1290ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-635367ec-5c1d-4b28-ac04-7584600f1bc0" returned: 0 in 0.351s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-635367ec-5c1d-4b28-ac04-7584600f1bc0" released by "delete_volume" :: held 2.014s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Attempting download of c5bbf2e3-0c20-4026-bec0-73cd8418be32 ((None, None)) to volume 3ebed19e-c0c0-4fa7-af97-24d4b483f36c. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 14:05:24 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Created reservations ['4ee3896c-7ad8-43bf-8547-cc0b8d550c91', '8feb6a95-fa2e-4015-8cf5-8633be2e2242', '07eed409-df4c-436c-a540-dcb3fff73cec', '477934d1-3213-45ab-8910-d76bb6d93edc'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6799a218-59c7-4569-abee-8a73c4d24b97]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5bbf2e3-0c20-4026-bec0-73cd8418be32_io19put5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created reservations ['7c3fcd87-7e30-40cb-a8ab-c98a5e51ed8d', '3cd17b20-7d94-456c-bcd8-461362cc9c4f', '170ee284-f39a-427d-8ca2-3491f76ba64a', 'ade165db-d998-4b7d-9658-bf7c23835b02'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5bbf2e3-0c20-4026-bec0-73cd8418be32_io19put5" returned: 0 in 0.690s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5bbf2e3-0c20-4026-bec0-73cd8418be32_io19put5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-b8fd6854-17e2-4289-8f8e-7de1d299bd5a-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.715s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-35d0a693-e2d8-4d67-84ee-8949884c9378-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:26 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Deleted volume successfully. Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-b8fd6854-17e2-4289-8f8e-7de1d299bd5a-delete_volume" acquired by "delete_volume" :: waited 0.465s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-35d0a693-e2d8-4d67-84ee-8949884c9378-delete_volume" acquired by "delete_volume" :: waited 0.504s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5bbf2e3-0c20-4026-bec0-73cd8418be32_io19put5" returned: 1 in 1.075s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5bbf2e3-0c20-4026-bec0-73cd8418be32_io19put5' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9015009-d81c-4a25-ab55-9f78eee7a4e0]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dbb17df6-78c2-4083-b756-d088a6ed0883 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-82f0eacf-2c6a-4507-9a60-ac12645eea8e-delete_volume" released by "delete_volume" :: held 5.354s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.586s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:27 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Deleted volume successfully. Sep 10 14:05:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-quobyte-35d0a693-e2d8-4d67-84ee-8949884c9378" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:27 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-quobyte-b8fd6854-17e2-4289-8f8e-7de1d299bd5a" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD" returned: 0 in 0.611s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-76f2e180-d395-4424-9ae0-9c83a6cf65ef tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-635367ec-5c1d-4b28-ac04-7584600f1bc0-delete_volume" released by "delete_volume" :: held 6.043s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-35d0a693-e2d8-4d67-84ee-8949884c9378" acquired by "delete_volume" :: waited 0.304s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-b8fd6854-17e2-4289-8f8e-7de1d299bd5a" acquired by "delete_volume" :: waited 0.296s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5387384c-0e5e-47a0-b50d-20a5d1465541]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58046e-db8d-4668-8dbb-0fb3b52fca2b]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD" returned: 1 in 0.537s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] c5bbf2e3-0c20-4026-bec0-73cd8418be32 was raw, converting to raw {{(pid=83206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:28 devstack quobyte-client[83260]: System call of process 101344 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:28 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=157, name=volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" returned: 0 in 0.297s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5bbf2e3-0c20-4026-bec0-73cd8418be32_efil368jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 14:05:28 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378" returned: 0 in 0.776s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a" returned: 0 in 0.900s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-35d0a693-e2d8-4d67-84ee-8949884c9378" returned: 0 in 0.216s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c 1G" returned: 0 in 0.477s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-35d0a693-e2d8-4d67-84ee-8949884c9378" released by "delete_volume" :: held 1.290s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c282cdfe-9380-479d-93d7-343e2270eca5]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-b8fd6854-17e2-4289-8f8e-7de1d299bd5a" returned: 0 in 0.316s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-b8fd6854-17e2-4289-8f8e-7de1d299bd5a" released by "delete_volume" :: held 1.776s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" returned: 0 in 0.567s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:29 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Created reservations ['50a100b6-659f-4fa1-a8e3-4245057553f2', 'c940f290-5a63-4402-82d3-7ff812439650', '8fd5988f-df21-42de-85cc-0af99e358816', '9ef29d3e-eb10-43e5-918d-c4d1dc18bcb3'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created reservations ['a26b3edf-481a-409f-a8ca-122cdca4f337', '7f90248e-39dd-4c51-bd96-0435108eb2eb', 'bcbc5f24-31ec-49b2-869c-995724916fc3', '10413474-d82b-496b-9d4d-faebef0b1070'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-5dedb88b-a12e-4230-83f1-ba1393fea4f1-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" returned: 1 in 0.924s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Downloaded image c5bbf2e3-0c20-4026-bec0-73cd8418be32 ((None, None)) to volume 3ebed19e-c0c0-4fa7-af97-24d4b483f36c successfully. {{(pid=83206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Temporary image c5bbf2e3-0c20-4026-bec0-73cd8418be32 for user 71a373cfc86c440da53ca8f42d0176c1 is deleted. {{(pid=83206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.volume_utils [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Marking volume 3ebed19e-c0c0-4fa7-af97-24d4b483f36c as bootable. {{(pid=83206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.504s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:30 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Deleted volume successfully. Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-5dedb88b-a12e-4230-83f1-ba1393fea4f1-delete_volume" acquired by "delete_volume" :: waited 0.255s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-176094a6-2304-4de8-92b2-6d9da3af7ce3-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Copying metadata from image c5bbf2e3-0c20-4026-bec0-73cd8418be32 to 3ebed19e-c0c0-4fa7-af97-24d4b483f36c. {{(pid=83206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Creating volume glance metadata for volume 3ebed19e-c0c0-4fa7-af97-24d4b483f36c backed by image c5bbf2e3-0c20-4026-bec0-73cd8418be32 with: {'image_id': 'c5bbf2e3-0c20-4026-bec0-73cd8418be32', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '62d6804058185f244664c569bcd07aad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-176094a6-2304-4de8-92b2-6d9da3af7ce3-delete_volume" acquired by "delete_volume" :: waited 0.473s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8f8ca236-73d2-40c4-ad36-a6cabd09ace6 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-35d0a693-e2d8-4d67-84ee-8949884c9378-delete_volume" released by "delete_volume" :: held 4.621s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "cinder-quobyte-5dedb88b-a12e-4230-83f1-ba1393fea4f1" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e23a75-5d48-4764-abf7-73df0bba6118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c', 'volume_size': 1, 'image_id': 'c5bbf2e3-0c20-4026-bec0-73cd8418be32', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62d6804058185f244664c569bcd07aad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13852b0342054a429c01b01bedcc750c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57a290580f66e0761f901609b2a7af59e409e03ed89123a2f7865a3d547abaafdc3c668f4381c502fa52c3b4f3148969d5a3b3315dc9e8ed0f7d7925fb1f0b11', 'id': 'c5bbf2e3-0c20-4026-bec0-73cd8418be32', 'created_at': datetime.datetime(2025, 9, 10, 12, 4, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5bbf2e3-0c20-4026-bec0-73cd8418be32/file', 'properties': {}}, 'image_service': }' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c5a5e4-560e-4074-8a61-7916324c40e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.484s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Deleted volume successfully. Sep 10 14:05:31 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Volume volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c (3ebed19e-c0c0-4fa7-af97-24d4b483f36c): created successfully Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c5a5e4-560e-4074-8a61-7916324c40e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Flow 'volume_create_manager' (dc305d94-75b9-4b98-9992-b1f8b86002c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-5dedb88b-a12e-4230-83f1-ba1393fea4f1" acquired by "delete_volume" :: waited 0.118s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-efd935cb-ca6b-4605-837c-ef6b2fff1a71 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-b8fd6854-17e2-4289-8f8e-7de1d299bd5a-delete_volume" released by "delete_volume" :: held 4.958s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd3d2df-618b-4772-a373-fcce18b43878]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:31 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-quobyte-176094a6-2304-4de8-92b2-6d9da3af7ce3" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:32 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-5dddad63-27cd-42b3-8211-6193c862b9ea tempest-VolumeImageDependencyTests-904804557 None] Created volume successfully. Sep 10 14:05:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Acquiring lock "cinder-3ebed19e-c0c0-4fa7-af97-24d4b483f36c-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-176094a6-2304-4de8-92b2-6d9da3af7ce3" acquired by "delete_volume" :: waited 0.223s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:32 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d147cb-1595-4868-afc8-10f34c6a23db]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Lock "cinder-3ebed19e-c0c0-4fa7-af97-24d4b483f36c-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1" returned: 0 in 1.066s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:33 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Acquiring lock "cinder-quobyte-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-5dedb88b-a12e-4230-83f1-ba1393fea4f1" returned: 0 in 0.461s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3" returned: 0 in 0.897s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-quobyte-5dedb88b-a12e-4230-83f1-ba1393fea4f1" released by "delete_volume" :: held 1.715s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Lock "cinder-quobyte-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" acquired by "delete_volume" :: waited 0.331s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912e313-e390-414b-af7a-87aaffea0102]: (4, 'raw') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-176094a6-2304-4de8-92b2-6d9da3af7ce3" returned: 0 in 0.606s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-176094a6-2304-4de8-92b2-6d9da3af7ce3" released by "delete_volume" :: held 1.660s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created reservations ['9eebeeb2-d2ae-46a4-a5e7-046adf73e659', '6fc681f1-b7c8-49ac-a435-80ebe915d23e', '2b6c0552-fab3-47c8-af31-e834c0fd1fd1', '1128921a-b459-404f-aeec-6764c782f8eb'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Created reservations ['35bb78c2-4c2b-488c-8a3b-a3cb52475dce', '09c679db-03ac-4133-b56e-3990afac0a46', '398cc2c3-cefc-428c-9807-edb54dd36280', 'f106bca2-8092-434c-b228-018be0e47d40'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" returned: 0 in 0.587s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" returned: 1 in 0.578s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c' failed. Not Retrying. {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:34 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f-delete_volume" acquired by "delete_volume" :: waited 0.342s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" returned: 0 in 0.414s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Lock "cinder-quobyte-3ebed19e-c0c0-4fa7-af97-24d4b483f36c" released by "delete_volume" :: held 1.720s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:35 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:35 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-quobyte-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.926s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f" acquired by "delete_volume" :: waited 0.273s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.577s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Deleted volume successfully. Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b588802-7c1c-44f4-8e91-ae8b3f97b93c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:36 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Deleted volume successfully. Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Created reservations ['3c860ee7-3f26-45d1-bfb2-e4013c92d8c7', '2b4f062e-675c-4771-8e6c-a183d21973e0', '756ca0ec-b04a-4202-9f9b-d596bf154956', 'a1a08099-e57b-4fa2-bd5e-1febd9b9a055'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-2dc348cf-5d7f-434c-ab88-73f72f2cd560 tempest-CreateVolumesFromImageTest-1736647008 None] Lock "cinder-5dedb88b-a12e-4230-83f1-ba1393fea4f1-delete_volume" released by "delete_volume" :: held 5.964s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-42fe9500-d0d4-41e7-85b2-e6af6f2a2d73 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-176094a6-2304-4de8-92b2-6d9da3af7ce3-delete_volume" released by "delete_volume" :: held 5.515s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f" returned: 0 in 0.705s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f" returned: 0 in 0.205s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f" released by "delete_volume" :: held 1.084s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.299s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:37 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Deleted volume successfully. Sep 10 14:05:37 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created reservations ['2dfc3990-02fa-4b42-be6a-846698ed8c63', 'e015077d-2ccc-4c01-8679-ce8d047a499e', 'e06c402e-d073-4cf3-b174-193cefe30103', '85068705-ffe1-4920-ad6e-b5595ca95bc7'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8cbfbcba-2751-4883-97a2-3eee1094ad5d tempest-VolumeImageDependencyTests-904804557 None] Lock "cinder-3ebed19e-c0c0-4fa7-af97-24d4b483f36c-delete_volume" released by "delete_volume" :: held 5.613s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.145s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Deleted volume successfully. Sep 10 14:05:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-bc5462f7-b0c3-4c07-b2b7-25c06747c156 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-7f9ca4c7-8b20-4432-92eb-cef5b3495f3f-delete_volume" released by "delete_volume" :: held 3.936s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-48e33896-5f47-4ced-9ed0-0a372bf32471-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-48e33896-5f47-4ced-9ed0-0a372bf32471-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:39 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "cinder-quobyte-48e33896-5f47-4ced-9ed0-0a372bf32471" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-48e33896-5f47-4ced-9ed0-0a372bf32471" acquired by "delete_volume" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f1b75-0aea-4ad1-9334-1c342c30f3c7]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471" returned: 0 in 0.582s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-48e33896-5f47-4ced-9ed0-0a372bf32471" returned: 0 in 0.215s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-quobyte-48e33896-5f47-4ced-9ed0-0a372bf32471" released by "delete_volume" :: held 1.284s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:40 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (434b093e-beb0-4832-a366-8161ac82f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3c9b4a-e464-49ba-a5a0-cccd73c99a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3c9b4a-e464-49ba-a5a0-cccd73c99a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344608277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a173b14-19f6-4e57-9b9a-199a2fe9b6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:40Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9220994-de30-49ca-bd26-70ba9f6baa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9220994-de30-49ca-bd26-70ba9f6baa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fbf3f2-2ebd-4c9f-9f99-be090a85b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fbf3f2-2ebd-4c9f-9f99-be090a85b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a173b14-19f6-4e57-9b9a-199a2fe9b6a4', 'volume_name': 'volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d885c6f9-7eb7-4b5a-9b7a-47e651f23318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d885c6f9-7eb7-4b5a-9b7a-47e651f23318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdb532a-aba3-497f-9f57-f1d182c2d20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:40 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume 1a173b14-19f6-4e57-9b9a-199a2fe9b6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4', 'volume_size': 1} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344608277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a173b14-19f6-4e57-9b9a-199a2fe9b6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:40Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Creating volume 1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:40 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:41 devstack quobyte-client[83260]: System call of process 101390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:41 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=158, name=volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 1073741824" returned: 0 in 0.491s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Created reservations ['a51ed348-18ef-4c51-9ffe-a66abfa3d415', '023e8564-ac57-401e-b148-7a4a3e1a6904', 'b2a1391e-afe9-4dbb-8caa-055e8a4e328e', '75b095e3-a504-4ac6-9314-e96659943148'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" returned: 0 in 0.335s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] <== create_volume: return (872ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdb532a-aba3-497f-9f57-f1d182c2d20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d14885-9bdd-4050-a2dd-f62a742633e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 (1a173b14-19f6-4e57-9b9a-199a2fe9b6a4): created successfully Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d14885-9bdd-4050-a2dd-f62a742633e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (434b093e-beb0-4832-a366-8161ac82f22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-58164e17-f90a-47bf-a122-dd0be5a02b60 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created volume successfully. Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Deleted volume successfully. Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-988ba0e1-514f-48c1-996e-60f7077796c5 tempest-CreateVolumesFromSourceVolumeTest-1928531261 None] Lock "cinder-48e33896-5f47-4ced-9ed0-0a372bf32471-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:42 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Creating offline snapshot 3fd18536-f270-49e4-af77-a7208c8ee16c of volume 1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 14:05:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[56230bfb-d174-49fa-a26a-d9512c98ff09]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" returned: 0 in 0.539s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:44 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=159, name=volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c 1G" returned: 0 in 0.338s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img rebase -u -b volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c" returned: 0 in 0.156s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c" returned: 0 in 0.101s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c" returned: 0 in 0.115s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.info" returned: 0 in 0.118s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 14:05:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.info" returned: 0 in 0.121s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:45 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-44043189-5792-4e1f-983e-1895c4a25614 tempest-CreateVolumesFromSnapshotTest-774724278 None] Create snapshot completed successfully Sep 10 14:05:46 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (64e920ce-6f54-43c5-adb9-0d5773dc8b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a25c53-41bb-42e3-97e5-376b838d014d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a25c53-41bb-42e3-97e5-376b838d014d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140366257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e599c42-f3bb-4f74-8413-64df945be3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:46Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d67618f-acc7-4c33-b554-cc29763f17ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d67618f-acc7-4c33-b554-cc29763f17ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8056ce0a-915f-4f8c-88ac-db1cf8630ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8056ce0a-915f-4f8c-88ac-db1cf8630ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e599c42-f3bb-4f74-8413-64df945be3d7', 'volume_name': 'volume-8e599c42-f3bb-4f74-8413-64df945be3d7', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380af46d-8e30-4833-8ee7-0f045f4dae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380af46d-8e30-4833-8ee7-0f045f4dae58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42d7651-ab25-4d96-8acf-805ecb7e651f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:46 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume 8e599c42-f3bb-4f74-8413-64df945be3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e599c42-f3bb-4f74-8413-64df945be3d7', 'volume_size': 1} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140366257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e599c42-f3bb-4f74-8413-64df945be3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:46Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Creating volume 8e599c42-f3bb-4f74-8413-64df945be3d7 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:46 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:46 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:47 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=161, name=volume-8e599c42-f3bb-4f74-8413-64df945be3d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:47 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (f4a41248-ee0e-49a5-b7ef-68edfdc6fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:47 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66774a0d-5e39-4377-a836-f2aeb5ae5c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7 1073741824" returned: 0 in 0.791s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66774a0d-5e39-4377-a836-f2aeb5ae5c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865397346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f2b9a9-e315-49a4-a2f0-3cc0d807c790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:47Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6341d1-2e0c-4c58-bf43-af0a66ed878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6341d1-2e0c-4c58-bf43-af0a66ed878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4328312d-2afc-42dc-9a86-3d3583374758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4328312d-2afc-42dc-9a86-3d3583374758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f2b9a9-e315-49a4-a2f0-3cc0d807c790', 'volume_name': 'volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067365d1-e8f9-4ce1-8cba-2409954a26d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067365d1-e8f9-4ce1-8cba-2409954a26d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ced6c6-878e-4b2b-885f-634e1d2b6ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:48 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume 52f2b9a9-e315-49a4-a2f0-3cc0d807c790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790', 'volume_size': 1} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7" returned: 0 in 0.519s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] <== create_volume: return (1350ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.272s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865397346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f2b9a9-e315-49a4-a2f0-3cc0d807c790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:47Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Creating volume 52f2b9a9-e315-49a4-a2f0-3cc0d807c790 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:48 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:48 devstack quobyte-client[83260]: System call of process 101414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:48 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=162, name=volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:48 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:48 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (0b220241-5bf4-4d19-97a2-f8ff8d6f44c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d083bd9f-0d15-4885-a549-df12b164421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42d7651-ab25-4d96-8acf-805ecb7e651f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e599c42-f3bb-4f74-8413-64df945be3d7', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb782cd-0b99-42df-a20d-e5fe866edc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d083bd9f-0d15-4885-a549-df12b164421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1065536766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d25490-4077-4df2-ab53-7d18784d59eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:48Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4612db31-650b-49a1-ac69-ffd60a59abbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4612db31-650b-49a1-ac69-ffd60a59abbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b9c74b-fd9c-4948-9076-b7d72fc94917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b9c74b-fd9c-4948-9076-b7d72fc94917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d25490-4077-4df2-ab53-7d18784d59eb', 'volume_name': 'volume-43d25490-4077-4df2-ab53-7d18784d59eb', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722bc0c2-fa84-482d-8188-1d509bc8f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722bc0c2-fa84-482d-8188-1d509bc8f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebcfd64-8caa-4207-beec-c2dcf89c48d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:49 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume 43d25490-4077-4df2-ab53-7d18784d59eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d25490-4077-4df2-ab53-7d18784d59eb', 'volume_size': 1} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (bc0d9474-2c32-45ff-9f6d-4e426934d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d676ed79-1141-43ee-aae4-c0bfb65c5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790 1073741824" returned: 0 in 1.055s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:49 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume volume-8e599c42-f3bb-4f74-8413-64df945be3d7 (8e599c42-f3bb-4f74-8413-64df945be3d7): created successfully Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb782cd-0b99-42df-a20d-e5fe866edc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:49 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (64e920ce-6f54-43c5-adb9-0d5773dc8b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:50 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-0b6fd00f-a6eb-45ab-8992-13df58de7b5f tempest-CreateVolumesFromSnapshotTest-774724278 None] Created volume successfully. Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d676ed79-1141-43ee-aae4-c0bfb65c5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162039252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:49Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6638292a-9a6b-4110-bd11-36d9e4c44f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6638292a-9a6b-4110-bd11-36d9e4c44f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b585751d-5dde-4378-832d-6f0e5194a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b585751d-5dde-4378-832d-6f0e5194a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0', 'volume_name': 'volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422ec967-0d0a-40d3-931c-10acceeddfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422ec967-0d0a-40d3-931c-10acceeddfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98417b0-db5f-440e-bf2a-604a8e510a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:50 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume 0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0', 'volume_size': 1} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790" returned: 0 in 0.793s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] <== create_volume: return (1888ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1065536766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d25490-4077-4df2-ab53-7d18784d59eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:48Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Creating volume 43d25490-4077-4df2-ab53-7d18784d59eb {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:50 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:50 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=163, name=volume-43d25490-4077-4df2-ab53-7d18784d59eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:50 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (60681c6b-ce33-4171-b790-c67dbcfcff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf92e1-f0bb-4183-b7fa-6e557bdbdc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ced6c6-878e-4b2b-885f-634e1d2b6ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:50 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ca9898-bd14-4dc5-a828-bdc94c613fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:51 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790 (52f2b9a9-e315-49a4-a2f0-3cc0d807c790): created successfully Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ca9898-bd14-4dc5-a828-bdc94c613fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (f4a41248-ee0e-49a5-b7ef-68edfdc6fa06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf92e1-f0bb-4183-b7fa-6e557bdbdc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-867360736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d332e0-4164-4cfd-a583-03eb943d4ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:50Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f79a355-39fa-448f-868c-78e1b97cd69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f79a355-39fa-448f-868c-78e1b97cd69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e380365-2759-4dc1-8aea-8f4cbaea3bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e380365-2759-4dc1-8aea-8f4cbaea3bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d332e0-4164-4cfd-a583-03eb943d4ea5', 'volume_name': 'volume-83d332e0-4164-4cfd-a583-03eb943d4ea5', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70297457-b76e-4625-b4c4-1717fcd3015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70297457-b76e-4625-b4c4-1717fcd3015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ac323b-ee2e-4c05-9b5c-9f18e6aed004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:51 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume 83d332e0-4164-4cfd-a583-03eb943d4ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d332e0-4164-4cfd-a583-03eb943d4ea5', 'volume_size': 1} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb 1073741824" returned: 0 in 0.783s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:51 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-2609128b-6266-4f09-a2c6-b6be0ee6912a tempest-CreateVolumesFromSnapshotTest-774724278 None] Created volume successfully. Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb" returned: 0 in 0.323s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] <== create_volume: return (1133ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162039252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:49Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Creating volume 0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:51 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:51 devstack quobyte-client[83260]: System call of process 101424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:51 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=164, name=volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebcfd64-8caa-4207-beec-c2dcf89c48d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d25490-4077-4df2-ab53-7d18784d59eb', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492f7048-2048-4319-a3af-d72dbe21b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:51 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume volume-43d25490-4077-4df2-ab53-7d18784d59eb (43d25490-4077-4df2-ab53-7d18784d59eb): created successfully Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492f7048-2048-4319-a3af-d72dbe21b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:51 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (0b220241-5bf4-4d19-97a2-f8ff8d6f44c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:52 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-19d84673-d269-4d8f-acc7-075f37a69f93 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created volume successfully. Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0 1073741824" returned: 0 in 0.567s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0" returned: 0 in 0.144s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] <== create_volume: return (767ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-867360736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d332e0-4164-4cfd-a583-03eb943d4ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93116f5f6d949f7939e6b5fad2a73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:05:50Z,use_quota=True,user_id='51299cf9fb18475fa86369661ff6f5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Creating volume 83d332e0-4164-4cfd-a583-03eb943d4ea5 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:05:52 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:52 devstack quobyte-client[83260]: System call of process 101429 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:05:52 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=165, name=volume-83d332e0-4164-4cfd-a583-03eb943d4ea5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98417b0-db5f-440e-bf2a-604a8e510a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:52 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d08681-f5d8-42bc-a22f-4be0727f691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:53 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0 (0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0): created successfully Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d08681-f5d8-42bc-a22f-4be0727f691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (bc0d9474-2c32-45ff-9f6d-4e426934d099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5 1073741824" returned: 0 in 0.569s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5" returned: 0 in 0.196s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] <== create_volume: return (824ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a84052cf-4d1e-40ec-8cd2-bf937a5f2427 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created volume successfully. Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ac323b-ee2e-4c05-9b5c-9f18e6aed004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d332e0-4164-4cfd-a583-03eb943d4ea5', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8849e313-828c-4fa6-8660-a0fb654f9333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:05:53 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume volume-83d332e0-4164-4cfd-a583-03eb943d4ea5 (83d332e0-4164-4cfd-a583-03eb943d4ea5): created successfully Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8849e313-828c-4fa6-8660-a0fb654f9333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:05:53 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Flow 'volume_create_manager' (60681c6b-ce33-4171-b790-c67dbcfcff5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:05:53 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-3904767b-aadd-4982-8c38-08cb4c9d77c1 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created volume successfully. Sep 10 14:05:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-83d332e0-4164-4cfd-a583-03eb943d4ea5-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:54 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-83d332e0-4164-4cfd-a583-03eb943d4ea5-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:55 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-83d332e0-4164-4cfd-a583-03eb943d4ea5" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:55 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-83d332e0-4164-4cfd-a583-03eb943d4ea5" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:55 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7866ae-d5ee-42e0-b4cc-b031e983824d]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5" returned: 0 in 0.568s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:55 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-83d332e0-4164-4cfd-a583-03eb943d4ea5" returned: 0 in 0.153s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-83d332e0-4164-4cfd-a583-03eb943d4ea5" released by "delete_volume" :: held 0.987s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Created reservations ['33fca562-094f-4e31-8b90-476444f2f22c', 'b7a38666-0a69-4628-9e71-2dc861a4f58a', '7205d8d4-df0d-49c8-abe8-6b9c3ec16609', 'c478d347-839f-49c5-a57e-15983271ec32'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.128s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:56 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:56 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Deleted volume successfully. Sep 10 14:05:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-c13a9b11-a136-48ed-9f78-f07b87434b2c tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-83d332e0-4164-4cfd-a583-03eb943d4ea5-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:57 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:05:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:57 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0" acquired by "delete_volume" :: waited 0.011s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:05:57 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d77fda7-b9b7-4520-8a34-1e67e1df0b5d]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:05:57 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0" returned: 0 in 0.543s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:58 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0" returned: 0 in 0.196s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:58 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0" released by "delete_volume" :: held 0.970s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:58 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:SELECT=83,cinder:UPDATE=142,cinder:DELETE=14,cinder:INSERT=32 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:05:58 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created reservations ['248dae4e-e3bf-46c9-916f-f47a12f18681', '36c1e266-5fe4-44d7-b89a-79f959c536fd', 'f969fbf1-10f1-47ab-8733-674f2d1ca9fd', '5986fcb1-19ba-47f6-98a5-1065ffff806d'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:05:58 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=145,cinder:SELECT=104,cinder:DELETE=18,cinder:INSERT=33 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.137s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:05:59 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Deleted volume successfully. Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-1c406da0-8828-48d9-80a4-1eadd7c0a658 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-0b2d8e67-5242-4fa8-89f7-79fc59e7d1f0-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-43d25490-4077-4df2-ab53-7d18784d59eb-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:05:59 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-43d25490-4077-4df2-ab53-7d18784d59eb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:00 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-43d25490-4077-4df2-ab53-7d18784d59eb" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:00 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-43d25490-4077-4df2-ab53-7d18784d59eb" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:00 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8b6c1-079b-446c-9241-12fc7d4b3429]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb" returned: 0 in 0.534s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:00 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-43d25490-4077-4df2-ab53-7d18784d59eb" returned: 0 in 0.107s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-43d25490-4077-4df2-ab53-7d18784d59eb" released by "delete_volume" :: held 0.834s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created reservations ['ed64813e-9c53-4265-8a90-622525d75b39', '97b332b1-bdde-47de-bac6-f8aea87ea08b', '278f591b-5b24-496f-9680-4aa40d667b06', '4d99f147-e680-4565-a14e-ec90e6992c45'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.099s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:01 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:01 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Deleted volume successfully. Sep 10 14:06:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b55482ac-f94b-4a84-bdbb-06e46b193f66 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-43d25490-4077-4df2-ab53-7d18784d59eb-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-52f2b9a9-e315-49a4-a2f0-3cc0d807c790-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-52f2b9a9-e315-49a4-a2f0-3cc0d807c790-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:02 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-52f2b9a9-e315-49a4-a2f0-3cc0d807c790" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:02 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-52f2b9a9-e315-49a4-a2f0-3cc0d807c790" acquired by "delete_volume" :: waited 0.013s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:02 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b6d87-3927-4d7d-9fb5-e5bfc1d63e95]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:02 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790" returned: 0 in 0.557s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:03 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-52f2b9a9-e315-49a4-a2f0-3cc0d807c790" returned: 0 in 0.139s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:03 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-52f2b9a9-e315-49a4-a2f0-3cc0d807c790" released by "delete_volume" :: held 0.963s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:03 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created reservations ['89765545-dd2a-4f78-a91e-d377ec955602', '0b3426c6-ff0e-4d82-a8cc-730652388fa2', 'b879a5f9-2e2b-46d2-abeb-9685b901b120', 'ef845b2c-6b6f-40bb-aced-9be5d0810959'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.151s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:04 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Deleted volume successfully. Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-8e599c42-f3bb-4f74-8413-64df945be3d7-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-96241d2d-7a0c-4c1a-9428-6bc831f9c5f7 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-52f2b9a9-e315-49a4-a2f0-3cc0d807c790-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:04 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-8e599c42-f3bb-4f74-8413-64df945be3d7-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:05 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-8e599c42-f3bb-4f74-8413-64df945be3d7" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:05 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-8e599c42-f3bb-4f74-8413-64df945be3d7" acquired by "delete_volume" :: waited 0.019s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:05 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd3775-911e-4fab-8c1a-012861d900c9]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7" returned: 0 in 0.638s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:05 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:06 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-8e599c42-f3bb-4f74-8413-64df945be3d7" returned: 0 in 0.143s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:06 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-8e599c42-f3bb-4f74-8413-64df945be3d7" released by "delete_volume" :: held 1.171s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:06 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Created reservations ['35dafd6e-0c23-48c0-ab2a-5916e737ade4', '4a20def9-4665-47b5-8622-72b6eca24321', '268c6ccb-9d40-4283-bde8-c077d83091b8', '60b3849f-9cb1-4a2e-929c-071f4446c144'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.145s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:07 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:07 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Deleted volume successfully. Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-6d30d962-4136-438c-856e-9b4b53bacd2b tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-8e599c42-f3bb-4f74-8413-64df945be3d7-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-3fd18536-f270-49e4-af77-a7208c8ee16c-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-3fd18536-f270-49e4-af77-a7208c8ee16c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:08 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-3fd18536-f270-49e4-af77-a7208c8ee16c" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-3fd18536-f270-49e4-af77-a7208c8ee16c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Deleting offline snapshot 3fd18536-f270-49e4-af77-a7208c8ee16c of volume 1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] snapshot_file for this snap is: volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed57a622-3381-4b4c-9d76-15f12595d15b]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:08 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:09 devstack quobyte-client[83260]: System call of process 101460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c" returned: 0 in 0.634s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:09 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 14:06:09 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0076f03f-35fe-4b52-aace-a2104ff99837]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:09 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" returned: 0 in 0.777s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:10 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:10 devstack quobyte-client[83260]: System call of process 101466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c" returned: 0 in 0.423s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4.3fd18536-f270-49e4-af77-a7208c8ee16c" returned: 0 in 0.167s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-3fd18536-f270-49e4-af77-a7208c8ee16c" released by "_delete_snapshot" :: held 2.661s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" released by "delete_snapshot" :: held 2.702s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:12 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created reservations ['e3c98e66-ec09-4a75-875e-c52becba50da', '97e32630-8f84-4c3d-8c82-3075799391f9', '151d67bc-0208-473a-b571-879aae064661', 'eb242c5d-75fa-4097-b222-97b7a0430ab3'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.403s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:12 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Delete snapshot completed successfully. Sep 10 14:06:12 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-f8283d9e-79d7-464d-9175-c60b495091f9 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-3fd18536-f270-49e4-af77-a7208c8ee16c-delete_snapshot" released by "delete_snapshot" :: held 3.945s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:13 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "cinder-quobyte-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:13 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" acquired by "delete_volume" :: waited 0.017s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:13 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[07524af8-d5d1-4e61-a355-cd4a34902067]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:13 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" returned: 0 in 0.557s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:14 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" returned: 0 in 0.163s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:14 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-quobyte-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4" released by "delete_volume" :: held 1.030s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:14 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Created reservations ['fd3b31d2-8936-4111-b12a-6dafcf1958de', 'ae1cce9e-83d2-4d02-971a-5e9b41346266', 'a02607d5-2869-43e7-a934-47a866140e9b', '1c3d3849-9b19-47ba-b64d-05531d5efe82'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.113s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:15 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Deleted volume successfully. Sep 10 14:06:15 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-41151ce0-54c7-44d8-b5d7-deb61e767b17 tempest-CreateVolumesFromSnapshotTest-774724278 None] Lock "cinder-1a173b14-19f6-4e57-9b9a-199a2fe9b6a4-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:21 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Flow 'volume_create_manager' (e9a6fec5-e8eb-423d-95f7-5bd4d125b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a150fa-15fc-46eb-b0cc-04952e91d5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a150fa-15fc-46eb-b0cc-04952e91d5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba4968-6e09-47c5-8688-dfa6ec8659bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9a6dcd7554fec896c06f6803814ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:06:21Z,use_quota=True,user_id='f4384725a3c24246b661d7416f50cf31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8253bb34-8f6d-4305-81b6-f09205830e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8253bb34-8f6d-4305-81b6-f09205830e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473898d5-5abe-42f8-b74d-a90bf4d3ba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473898d5-5abe-42f8-b74d-a90bf4d3ba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ba4968-6e09-47c5-8688-dfa6ec8659bd', 'volume_name': 'volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9ec965-428b-4fbf-a2a5-deafe28a6f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9ec965-428b-4fbf-a2a5-deafe28a6f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149c5796-469a-4dc0-a19c-27d28a783b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:21 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Volume 15ba4968-6e09-47c5-8688-dfa6ec8659bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd', 'volume_size': 1} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba4968-6e09-47c5-8688-dfa6ec8659bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9a6dcd7554fec896c06f6803814ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:06:21Z,use_quota=True,user_id='f4384725a3c24246b661d7416f50cf31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Creating volume 15ba4968-6e09-47c5-8688-dfa6ec8659bd {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:06:21 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:06:21 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:21 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:22 devstack quobyte-client[83260]: System call of process 101515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:06:22 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=166, name=volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Flow 'volume_create_manager' (5ab377c3-ceeb-4afc-9606-516a3f9ed4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4119d3c5-9b55-4d02-8498-2ef3fba06e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4119d3c5-9b55-4d02-8498-2ef3fba06e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1195454494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dc1a86-2426-4dc4-b35f-7d71f92e9dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cf8e6af5444696a128f6b2ba35e954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:06:21Z,use_quota=True,user_id='74ecd21bb26849bf80bd7599d6ff060d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9975f6-2980-4621-b9cc-78f47b5abef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9975f6-2980-4621-b9cc-78f47b5abef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b25010-a68c-4c66-96fa-d97bddbc3484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b25010-a68c-4c66-96fa-d97bddbc3484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dc1a86-2426-4dc4-b35f-7d71f92e9dbd', 'volume_name': 'volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445b55c8-2ac4-494e-bf73-297484c25f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445b55c8-2ac4-494e-bf73-297484c25f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282883c1-955d-416b-a1cf-addf75c4a781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:22 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Volume 51dc1a86-2426-4dc4-b35f-7d71f92e9dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd', 'volume_size': 1} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd 1073741824" returned: 0 in 0.626s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd" returned: 0 in 0.127s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] <== create_volume: return (804ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1195454494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dc1a86-2426-4dc4-b35f-7d71f92e9dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cf8e6af5444696a128f6b2ba35e954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:06:21Z,use_quota=True,user_id='74ecd21bb26849bf80bd7599d6ff060d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Creating volume 51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:06:22 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:06:22 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:23 devstack quobyte-client[83260]: System call of process 101520 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:23 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=167, name=volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149c5796-469a-4dc0-a19c-27d28a783b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcbec82-b704-44e2-bdd7-e1c1a0df380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:23 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Volume volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd (15ba4968-6e09-47c5-8688-dfa6ec8659bd): created successfully Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcbec82-b704-44e2-bdd7-e1c1a0df380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Flow 'volume_create_manager' (e9a6fec5-e8eb-423d-95f7-5bd4d125b74c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd 1073741824" returned: 0 in 0.580s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:23 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a4f71b14-b0c8-4666-9f94-5b26720525eb tempest-CinderUnicodeTest-1090585131 None] Created volume successfully. Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" returned: 0 in 0.329s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] <== create_volume: return (942ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282883c1-955d-416b-a1cf-addf75c4a781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdd7e10-be46-4f19-b4bf-e76b89d9813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:23 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Volume volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd (51dc1a86-2426-4dc4-b35f-7d71f92e9dbd): created successfully Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdd7e10-be46-4f19-b4bf-e76b89d9813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:23 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Flow 'volume_create_manager' (5ab377c3-ceeb-4afc-9606-516a3f9ed4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:24 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-bac0a1f0-5b3b-45d6-b1d0-ef47c54cbf86 tempest-SnapshotDependencyTests-532838533 None] Created volume successfully. Sep 10 14:06:25 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:25 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Flow 'volume_create_manager' (74a29210-0ee8-46ab-9101-4e47eaf02214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920060f5-7d52-4f25-bda5-b24c907161a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Creating offline snapshot 273e16d1-95e1-489b-a2e7-907c9a98db45 of volume 51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920060f5-7d52-4f25-bda5-b24c907161a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:06:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1064154740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3053b463-9235-4eb3-939c-faf6df91fa39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9a6dcd7554fec896c06f6803814ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:06:26Z,use_quota=True,user_id='f4384725a3c24246b661d7416f50cf31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a158b5f2-a7cd-49dd-bade-0d3d05e38218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a158b5f2-a7cd-49dd-bade-0d3d05e38218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02384354-e164-49b3-816f-322776eb43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02384354-e164-49b3-816f-322776eb43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3053b463-9235-4eb3-939c-faf6df91fa39', 'volume_name': 'volume-3053b463-9235-4eb3-939c-faf6df91fa39', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddd2d25-5ace-4811-b56f-c88e98157f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddd2d25-5ace-4811-b56f-c88e98157f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f514ebe-fff3-48cc-a6b4-0693c6cb33b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:25 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Volume 3053b463-9235-4eb3-939c-faf6df91fa39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3053b463-9235-4eb3-939c-faf6df91fa39', 'volume_size': 1} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:25 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[877ae62d-d3ed-4956-942b-977e8cad61c2]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" returned: 0 in 0.442s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:26 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=168, name=volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:06:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 1G" returned: 0 in 0.316s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:26 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): qemu-img rebase -u -b volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:26 devstack quobyte-client[83260]: System call of process 101530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] CMD "qemu-img rebase -u -b volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45" returned: 0 in 0.165s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45" returned: 0 in 0.088s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45" returned: 0 in 0.202s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.info" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.info" returned: 0 in 0.085s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.857s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:06:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1064154740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3053b463-9235-4eb3-939c-faf6df91fa39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9a6dcd7554fec896c06f6803814ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:06:26Z,use_quota=True,user_id='f4384725a3c24246b661d7416f50cf31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)}" {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Creating volume 3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:06:27 devstack cinder-volume[83206]: INFO cinder.volume.drivers.remotefs [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] casted to 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 Sep 10 14:06:27 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 1073741824 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:28 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=170, name=volume-3053b463-9235-4eb3-939c-faf6df91fa39, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:06:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a5abc6f9-8338-4efa-8737-040124746473 tempest-SnapshotDependencyTests-532838533 None] Create snapshot completed successfully Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 1073741824" returned: 0 in 0.397s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39" returned: 0 in 0.094s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] <== create_volume: return (547ms) {'provider_location': '10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'} {{(pid=83206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.573s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f514ebe-fff3-48cc-a6b4-0693c6cb33b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3053b463-9235-4eb3-939c-faf6df91fa39', 'volume_size': 1}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ce6686-5259-45b3-afd0-23b2ab1a8871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:28 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Volume volume-3053b463-9235-4eb3-939c-faf6df91fa39 (3053b463-9235-4eb3-939c-faf6df91fa39): created successfully Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ce6686-5259-45b3-afd0-23b2ab1a8871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:28 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Flow 'volume_create_manager' (74a29210-0ee8-46ab-9101-4e47eaf02214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:28 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-ca997239-93c2-453c-b094-0591e842583d tempest-CinderUnicodeTest-1090585131 None] Created volume successfully. Sep 10 14:06:29 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:29 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Creating offline snapshot 9847c587-427f-4de5-8464-7458412b577a of volume 3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 14:06:29 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73342009-724e-4ba1-b13e-76dfe775803c]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:29 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:30 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Flow 'volume_create_manager' (ee644b01-39c7-4f1d-addb-2f3322864b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64567ab1-bee2-4e9f-8939-c6db5ca08eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64567ab1-bee2-4e9f-8939-c6db5ca08eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T12:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656e0c1c-758d-40a5-8658-da5583af28d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cf8e6af5444696a128f6b2ba35e954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=273e16d1-95e1-489b-a2e7-907c9a98db45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:06:30Z,use_quota=True,user_id='74ecd21bb26849bf80bd7599d6ff060d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e1511-4f53-43d6-8c03-d23239d21402),volume_type_id=903e1511-4f53-43d6-8c03-d23239d21402)' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30acd64-fbbd-4b66-9e59-244a47b4f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30acd64-fbbd-4b66-9e59-244a47b4f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18673e68-3570-4bb5-88b5-568790b0a462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18673e68-3570-4bb5-88b5-568790b0a462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '656e0c1c-758d-40a5-8658-da5583af28d5', 'volume_name': 'volume-656e0c1c-758d-40a5-8658-da5583af28d5', 'volume_size': 1, 'snapshot_id': '273e16d1-95e1-489b-a2e7-907c9a98db45'}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b690e9-2c50-4b7f-a35c-3c508bbe41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b690e9-2c50-4b7f-a35c-3c508bbe41a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eed8698-6f21-45c1-acd3-b1b5cd978950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:30 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Volume 656e0c1c-758d-40a5-8658-da5583af28d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-656e0c1c-758d-40a5-8658-da5583af28d5', 'volume_size': 1, 'snapshot_id': '273e16d1-95e1-489b-a2e7-907c9a98db45'} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39" returned: 0 in 0.734s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a 1G {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:30 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=171, name=volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a 1G" returned: 0 in 0.271s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:30 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3053b463-9235-4eb3-939c-faf6df91fa39 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] CMD "qemu-img rebase -u -b volume-3053b463-9235-4eb3-939c-faf6df91fa39 -F qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a" returned: 0 in 0.151s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a" returned: 0 in 0.087s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Setting permissions: /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 -> 1000:1000 {{(pid=83206) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a" returned: 0 in 0.087s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.info" returned: 0 in 0.093s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.info is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.info {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.info" returned: 0 in 0.103s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.108s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-quobyte-273e16d1-95e1-489b-a2e7-907c9a98db45-656e0c1c-758d-40a5-8658-da5583af28d5" by "_create_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:31 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-1714bd8a-f46a-4256-a379-fba459a9d1eb tempest-CinderUnicodeTest-1090585131 None] Create snapshot completed successfully Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-273e16d1-95e1-489b-a2e7-907c9a98db45-656e0c1c-758d-40a5-8658-da5583af28d5" acquired by "_create_volume_from_snapshot" :: waited 0.182s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Creating volume 656e0c1c-758d-40a5-8658-da5583af28d5 from snapshot 273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Selected 10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9 as target Quobyte volume. {{(pid=83206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-quobyte-656e0c1c-758d-40a5-8658-da5583af28d5" by "_copy_volume_from_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-656e0c1c-758d-40a5-8658-da5583af28d5" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] snapshot: 273e16d1-95e1-489b-a2e7-907c9a98db45, volume: 656e0c1c-758d-40a5-8658-da5583af28d5, {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80748ae2-12d8-4dac-a1e5-0d176524e5af]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:31 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45" returned: 0 in 0.353s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Creating direct copy from snapshot {{(pid=83206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85d1750-cab8-43cb-b697-2a1ef9f14387]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "cinder-9847c587-427f-4de5-8464-7458412b577a-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:32 devstack quobyte-client[83260]: System call of process 101558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-9847c587-427f-4de5-8464-7458412b577a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.127s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:32 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "cinder-quobyte-3053b463-9235-4eb3-939c-faf6df91fa39" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:32 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" returned: 0 in 0.593s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG cinder.utils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5 not found in is_blk_device check {{(pid=83206) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-3053b463-9235-4eb3-939c-faf6df91fa39" acquired by "delete_snapshot" :: waited 0.207s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "cinder-quobyte-9847c587-427f-4de5-8464-7458412b577a" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:33 devstack quobyte-client[83260]: The server volume:9722c971-32f0-4d12-a219-e1a443cac4e1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9722c971-32f0-4d12-a219-e1a443cac4e1, inode=173, name=volume-656e0c1c-758d-40a5-8658-da5583af28d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.43), requestorAccessMask=0 Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-9847c587-427f-4de5-8464-7458412b577a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Deleting offline snapshot 9847c587-427f-4de5-8464-7458412b577a of volume 3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] snapshot_file for this snap is: volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61105ed1-e96b-49be-9f7c-1b315a996bb6]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:33 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:34 devstack quobyte-client[83260]: System call of process 101564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a" returned: 0 in 0.885s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:34 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3053b463-9235-4eb3-939c-faf6df91fa39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 14:06:34 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e09a48-9f13-4173-8149-04c2af171b9d]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:34 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39" returned: 0 in 1.052s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:35 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:35 devstack quobyte-client[83260]: System call of process 101577 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:35 devstack quobyte-client[83260]: System call of process 101577 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 14:06:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a" returned: 0 in 0.658s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:36 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39.9847c587-427f-4de5-8464-7458412b577a" returned: 0 in 0.292s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:36 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-9847c587-427f-4de5-8464-7458412b577a" released by "_delete_snapshot" :: held 3.720s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:37 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-3053b463-9235-4eb3-939c-faf6df91fa39" released by "delete_snapshot" :: held 3.831s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:37 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Created reservations ['9cc89f9a-87d8-4d5c-a48c-2bf71e871887', 'b39fc80b-3ba3-4ca5-90f8-779421f2459a', '71964c1c-107f-4985-9877-439ca7a4527a', '7e68f7fb-879d-414c-a0a2-8ead68a39877'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:38 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Delete snapshot completed successfully. Sep 10 14:06:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-7172b31c-fbc5-4d45-905e-a783d7f4aae1 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-9847c587-427f-4de5-8464-7458412b577a-delete_snapshot" released by "delete_snapshot" :: held 5.392s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "cinder-3053b463-9235-4eb3-939c-faf6df91fa39-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:38 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-3053b463-9235-4eb3-939c-faf6df91fa39-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:39 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "cinder-quobyte-3053b463-9235-4eb3-939c-faf6df91fa39" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:39 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-3053b463-9235-4eb3-939c-faf6df91fa39" acquired by "delete_volume" :: waited 0.066s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:39 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73f13ee-619f-47bc-bb26-a31aaf7f5112]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:39 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5" returned: 0 in 7.209s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[224b60b6-55d3-4f43-8135-b6e0165bc69e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39" returned: 0 in 1.028s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-3053b463-9235-4eb3-939c-faf6df91fa39" returned: 0 in 0.106s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-3053b463-9235-4eb3-939c-faf6df91fa39" released by "delete_volume" :: held 1.437s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:40 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" returned: 0 in 0.730s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.image.image_utils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Image conversion details: src /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5 {{(pid=83206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 14:06:41 devstack cinder-volume[83206]: INFO cinder.image.image_utils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Converted 1024.00 MB image at 141.49 MB/s Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] File path /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5 is being set with permissions: 660 {{(pid=83206) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5" returned: 0 in 0.262s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-656e0c1c-758d-40a5-8658-da5583af28d5" released by "_copy_volume_from_snapshot" :: held 9.458s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-273e16d1-95e1-489b-a2e7-907c9a98db45-656e0c1c-758d-40a5-8658-da5583af28d5" released by "_create_volume_from_snapshot" :: held 9.555s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.754s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Created reservations ['9692a05f-d94f-41d9-9510-80ba612428ac', '2e7225bd-634f-4d0c-be2d-3ba470960266', '7e7ddf0a-30b3-49df-bdb9-25ca4a9a3bb0', 'd2b47f2a-2b1d-45e6-b47b-14ca6b0bc87d'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eed8698-6f21-45c1-acd3-b1b5cd978950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656e0c1c-758d-40a5-8658-da5583af28d5', 'volume_size': 1, 'snapshot_id': '273e16d1-95e1-489b-a2e7-907c9a98db45'}' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efe2217-6db9-4a10-88f1-309d3ac88b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 14:06:41 devstack cinder-volume[83206]: INFO cinder.volume.flows.manager.create_volume [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Volume volume-656e0c1c-758d-40a5-8658-da5583af28d5 (656e0c1c-758d-40a5-8658-da5583af28d5): created successfully Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efe2217-6db9-4a10-88f1-309d3ac88b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83206) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Flow 'volume_create_manager' (ee644b01-39c7-4f1d-addb-2f3322864b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83206) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:41 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8ce32537-82f6-40c9-a4f2-c0180ee45c8d tempest-SnapshotDependencyTests-532838533 None] Created volume successfully. Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.238s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:41 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:42 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Deleted volume successfully. Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-8934a244-62bf-47be-bdb1-0ff99cbde51f tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-3053b463-9235-4eb3-939c-faf6df91fa39-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "cinder-15ba4968-6e09-47c5-8688-dfa6ec8659bd-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-15ba4968-6e09-47c5-8688-dfa6ec8659bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:42 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "cinder-quobyte-15ba4968-6e09-47c5-8688-dfa6ec8659bd" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-15ba4968-6e09-47c5-8688-dfa6ec8659bd" acquired by "delete_volume" :: waited 0.009s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dadcdb-0887-455b-a1e1-e5718e377f3e]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:42 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-273e16d1-95e1-489b-a2e7-907c9a98db45-delete_snapshot" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-273e16d1-95e1-489b-a2e7-907c9a98db45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:43 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-quobyte-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" by "delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-quobyte-273e16d1-95e1-489b-a2e7-907c9a98db45" by "_delete_snapshot" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-273e16d1-95e1-489b-a2e7-907c9a98db45" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Deleting offline snapshot 273e16d1-95e1-489b-a2e7-907c9a98db45 of volume 51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] snapshot_file for this snap is: volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e73f36-ebc9-4d15-a417-10b59ef6fe61]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd" returned: 0 in 0.660s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-15ba4968-6e09-47c5-8688-dfa6ec8659bd" returned: 0 in 0.137s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-quobyte-15ba4968-6e09-47c5-8688-dfa6ec8659bd" released by "delete_volume" :: held 0.975s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45" returned: 0 in 0.600s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.remotefs [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[56087bee-7f27-4c20-a439-0be05d1de9d5]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:43 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:44 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Created reservations ['5a8da38d-6b27-44c9-bad7-5f4068e555a4', 'd3790155-882c-48a8-9643-539b403023f8', 'e501807c-45bb-404e-9452-9a567851426d', 'f54387f4-81a3-4f66-a422-da85aabc300e'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" returned: 0 in 0.545s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45" returned: 0 in 0.261s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:44 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd.273e16d1-95e1-489b-a2e7-907c9a98db45" returned: 0 in 0.232s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-273e16d1-95e1-489b-a2e7-907c9a98db45" released by "_delete_snapshot" :: held 2.077s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" released by "delete_snapshot" :: held 2.165s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.424s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:45 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:45 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Deleted volume successfully. Sep 10 14:06:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-a1626987-a4b0-474b-884c-d46835a55333 tempest-CinderUnicodeTest-1090585131 None] Lock "cinder-15ba4968-6e09-47c5-8688-dfa6ec8659bd-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:46 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Created reservations ['4ade7dfa-cdd5-450f-ab73-eb3b7ffbc8c3', '9d202e60-c239-4d00-a3af-1a7e8bbbde16', '64f1a24b-0dc6-4064-b4f5-911ef8e66ca7', '727821b6-f8b6-4231-8d5d-02d78dc03428'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:46 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Delete snapshot completed successfully. Sep 10 14:06:46 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-b785910a-e200-40ad-9d80-33bc3ffcc43c tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-273e16d1-95e1-489b-a2e7-907c9a98db45-delete_snapshot" released by "delete_snapshot" :: held 3.331s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:47 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-quobyte-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" acquired by "delete_volume" :: waited 0.012s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80287d15-25e9-48b4-a179-0ce7de6a1228]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" returned: 0 in 0.463s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:47 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" returned: 0 in 0.112s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd" released by "delete_volume" :: held 0.744s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Created reservations ['11e5de8e-7016-43ab-acd2-b615e8e0a35b', '40dc03b1-c4dc-49fb-b936-541327a048d7', 'cd38d5c8-a81d-40af-91fd-93c6928076d6', '2e03addd-e4d1-40d2-b0a7-03b90f463359'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.126s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:48 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Deleted volume successfully. Sep 10 14:06:48 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-14d1944b-f39d-4a04-aa97-cea617d33db8 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-51dc1a86-2426-4dc4-b35f-7d71f92e9dbd-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-656e0c1c-758d-40a5-8658-da5583af28d5-delete_volume" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-656e0c1c-758d-40a5-8658-da5583af28d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:49 devstack cinder-volume[83206]: WARNING cinder.volume.volume_utils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 14:06:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "cinder-quobyte-656e0c1c-758d-40a5-8658-da5583af28d5" by "delete_volume" {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 14:06:49 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-656e0c1c-758d-40a5-8658-da5583af28d5" acquired by "delete_volume" :: waited 0.014s {{(pid=83206) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 14:06:49 devstack cinder-volume[83206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080a0c2-96bf-4b68-b00b-0ddcf2edf7f9]: (4, 'qcow2') {{(pid=84394) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 14:06:49 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5" returned: 0 in 0.398s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5 {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:50 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] CMD "rm -f /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba/volume-656e0c1c-758d-40a5-8658-da5583af28d5" returned: 0 in 0.083s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:50 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-quobyte-656e0c1c-758d-40a5-8658-da5583af28d5" released by "delete_volume" :: held 0.633s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:06:50 devstack cinder-volume[83206]: DEBUG cinder.quota [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Created reservations ['5b7d2fe3-2961-40e3-b23f-2653ee0ae3a4', '9ada28c8-7e2f-440f-90e3-21c7bfcfaa49', '88583b9c-39bc-4413-bf3f-06607ee1cde8', '6ef87f34-abfb-4344-aa70-4a5950b7a9be'] {{(pid=83206) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.111s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 14:06:51 devstack cinder-volume[83206]: INFO cinder.volume.manager [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Deleted volume successfully. Sep 10 14:06:51 devstack cinder-volume[83206]: DEBUG cinder.coordination [None req-dfca08b5-3c0a-484e-a627-039dd36a2224 tempest-SnapshotDependencyTests-532838533 None] Lock "cinder-656e0c1c-758d-40a5-8658-da5583af28d5-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=83206) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 14:07:00 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=109,cinder:SELECT=65,cinder:DELETE=6,cinder:INSERT=30 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:07:01 devstack cinder-volume[83206]: DEBUG dbcounter [-] [83206] Writing DB stats cinder:UPDATE=87,cinder:SELECT=63,cinder:INSERT=14,cinder:DELETE=9 {{(pid=83206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 14:07:11 devstack cinder-volume[83206]: DEBUG oslo_service.periodic_task [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 14:07:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 14:07:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 14:07:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9': None} {{(pid=83206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 14:07:11 devstack cinder-volume[83206]: DEBUG cinder.volume.drivers.quobyte [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Available shares ['10.10.41.181/cinder-vol-8e48b424-dc7e-4db5-a106-c8dc9a123db9'] {{(pid=83206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 14:07:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.lockutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 14:07:11 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 14:07:12 devstack cinder-volume[83206]: DEBUG oslo_concurrency.processutils [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/93964c9538a5db38b091adc754ad2aba" returned: 0 in 0.098s {{(pid=83206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 14:07:12 devstack cinder-volume[83206]: DEBUG cinder.manager [None req-49b83ce8-1c59-4315-aed2-aae16e4c7f1b None None] Notifying Schedulers of capabilities ... {{(pid=83206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}